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I.  INTRODUCTION 


A  major  problem  in  advanced,  technologically  oriented  organiza¬ 
tions,  such  as  the  Air  Force,  is  the  determination  of  the  ability  require¬ 
ments  for  job  performance.  Job  descriptions,  in  terms  of  ability  re¬ 
quirements,  support  a  variety  of  purposes,  such  as  establishing  job  en¬ 
try  requirements,  classification  and  assignment,  performance  evalua¬ 
tion,  training  requirements  derivation,  and  career  development. 

This  report  presents  the  methods,  procedures,  and  results  of  a 
study  which  sought 


1.  To  develop  a  perceptual/  psychomotor  taxonomy  of 
abilities  applicable  to  Air  Force  career  fields. 

2.  To  apply  the  taxonomy  to  a  variety  of  Air  Force 
specialties  in  order  to  describe  the  perceptual/ 
psychomotor  abilities  inherent  to  the  job  perform¬ 
ance  of  personnel  in  these  specialties. 


While  the  Air  Force  routinely  collects  information  about  job 
characteristics  through  its  Comprehensive  Occupational  Data  Analysis 
Program  (CODAP)  system  (Christal,  1974),  this  information  has  not 
dealt  with  perceptual/ psychomotor  requirements.  Moreover,  although 
there  has  been  substantial  progress  toward  predicting  success  in  Air 
Force  technical  training  schools  and  (to  a  lesser  extent)  job  performance 
on  the  basis  of  academic/ cognitive  skills,  there  has  been  little,  if  any, 
emphasis  on  prediction  based  on  perceptual/ psychomotor  abilities.  It  is 
quite  possible  that  inclusion  of  perceptual/ psychomotor  ability  consider¬ 
ations  in  such  predictions  would  substantially  enhance  predictive  power. 
This  holds,  because,  on  the  surface,  it  seems  that  perceptual/ psycho¬ 
motor  ability  is  basic  to  a  large  part  of  the  performance  of  Air  Force 
enlisted  personnel. 

The  objective  of  the  present  study  was  to  describe  the  perceptual/ 
psychomotor  requirements  of  35  Air  Force  specialties.  However,  before 
such  requirements  could  be  established,  some  basic  needs  had  to  be  met, 
including: 

1.  A  perceptual/ pscyhomotor  taxonomy  that  is  defen¬ 
sible,  comprehensive,  scalable,  and  applicable  to 
the  work  of  Air  Force  career  fields. 

2.  A  method  for  economically  collecting  the  informa¬ 
tion  dictated  by  the  taxonomy. 
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3.  An  information  collection  method  that  met  accept¬ 
able  measurement  standards  and  was  reasonably 
free  from  error. 

Subsequent  sections  of  this  report  describe  the  steps  taken  to 
meet  each  of  these  needs.  Then,  the  methods  and  results  of  a  survey 
to  establish  the  perceptual/ psychomotor  requirements  of  35  Air  Force 
specialties  are  described.  These  data  can  now  provide  a  basis  for  fu¬ 
ture  programs  which  exploit  perceptual/ psychomotor  performance  re¬ 
quirements  in  the  Air  Force. 


II.  TAXONOMY  DEVELOPMENT 


A  taxonomy  is  a  "classification  of  data  according  to  their  natur¬ 
al  relationships  or  the  principle  gove  rning  such  classification"  (English 
&  English,  1958)  or  "a  way  of  simplifying  a  complicated  universe  of  in¬ 
dividual  events  and  objects  according  to  some  useful  way  of  identifying 
the  way  in  which  groups  of  individuals  (or  observations)  have  things  in 
common  or  differ"  (Miller,  1967),  In  short,  a  taxonomy  is  a  classifica' 
tion  system.  The  desirable  characteristics  in  an  Air  Force  oriented  be 
havioral  taxonomy,  as  extrapolated  from  Miller  (1967)  and  Fleishman 
(1975),  are 

1.  Compatibility--the  scheme  should  be  fully  com¬ 
patible  with  the  Air  Force  task  structure. 

2.  Understandability--the  scheme  must  be  readily 
apparent  and  comprehensible  to  Air  Force  users. 

3.  Objectivity- -the  standards  for  evaluation  must 
be  free  from  bias. 

4.  Scalability--the  technique  should  allow  for  the  as¬ 
signment  of  a  magnitude  value  (a  number)  to  the 
tasks  of  a  job  relative  to  each  class  in  the  scheme. 

5.  Practicality- -the  scheme  should  be  relatively  sim¬ 
ple  to  apply  and  interpret  and  should  not  place  un¬ 
due  time  requirements  on  operational  personnel. 

6.  Validity--the  scheme  should  be  based  on  accepta¬ 
ble  constructs  relevant  to  Air  Force  job  content, 
and  seem  reasonable  to  the  Air  Force  users. 

7.  Reliability--the  scheme  should  be  amenable  to  psy- 
chometrically  reliable  data  acquisition  methods. 

8.  Comprehensive,  generality,  and  flexibility- -the 
scheme  should  be  applicable  to  the  full  range  of 
tasks  involved  in  Air  Force  career  fields. 

9.  Cost  effective  - -the  taxonomy  should  have  charac¬ 
teristics  that  permit  it  to  be  embedded  within  a 
scheme  that  is  relatively  inexpensive  to  employ 
and  the  taxonomy  should  be  purposeful  in  estab¬ 
lishing  an  appropriate  job-personnel  interface. 

10.  Unidimensionality- -each  skill  within  the  scheme 
should  be  unique. 
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Perceptual/ Psychomotor  Taxonomies 

A  number  of  rather  general  taxonomies  have  been  developed 
over  the  years  (Ragsdale,  1950;  Fitts,  1962;  Simpson,  1972;  McCormick, 
Jeanneret,  &  Mecham,  1969;  Kibler,  Barker,  &  Miles,  1970;  Greenstein, 
1976).  These  systems  attempted  to  establish  broad  categories  and  classes 
into  which  behaviors  could  be  classified.  They  do  not  deal  with  percep¬ 
tual/psychomotor  abilities  per  se  and,  therefore,  are  not  reviewed  here¬ 
in. 


Major  Perceptual  Motor  Ability  Taxonomies  Prior  to  1968 

Prior  to  1968,  the  most  important  taxonomies  developed  utilizing 
perceptual/ psychomotor  descriptors  were  those  of  Berliner  (Rabideau, 
1966),  and  Fleishman  (1967). 

Berliner's  Taxonomy 

The  first  formal  task  classification  system  utilizing  perceptual/ 
psychomotor  descriptors  is  the  Berliner  three-tier  system  (see  Rabideau, 
1964).  The  Berliner  system,  shown  in  Table  2-1,  classifies  tasks  in  terms 
of  intervening  human  processes  or  functions  as  related  to  general  work 
activities  and  specific  behaviors  or  tasks.  The  Berliner  taxonomy  was 
developed  to  organize  and  define  the  measurement  of  task  performance, 
and  provides  a  useful  scheme  for  analyzing  man-machine  systems. 

The  perceptual  motor  components  in  the  Berliner  system  corre¬ 
spond  to  the  processes  identified  as  perceptual  and  motor.  Using  such 
descriptors,  the  system  describes  man-machine  performance  in  terms 
of  human  behaviors,  and  outlines  the  human  processes  required  to  per¬ 
form  the  tasks.  No  detailed  definitions  of  the  processes  are  given.  The 
major  emphasis  is  on  the  human  activities.  Accordingly,  the  Berliner 
taxonomy  can  best  be  considered  as  a  behavioral  description  rather  than 
a  behavioral  requirements  approach  to  task  classification. 

Several  other  authors  have  followed  Berliner  in  developing  simi¬ 
lar  types  of  taxonomies,  for  example,  Alluisi  (1967)  and  Chambers  (1973). 
As  with  Berliner,  these  two  taxonomies  utilize  perceptual/ psychomotor 
functions,  but  emphasize  the  human  activities  or  tasks.  Such  taxonomic 
systems  suggest  the  perceptual/ psychomotor  abilities  required  to  perform 
tasks.  However,  the  taxonomies  are  too  broad  or  vague  to  identify  the 
amount  or  type  of  perceptual/ psychomotor  ability  required.  Taken  togeth¬ 
er,  the  three  systems  appear  to  be  descriptive,  nonrigorous,  qualitative, 
and  general  types  of  taxonomies.  They  were  subjectively  developed  and 
depend  heavily  on  verbal  descriptions,  with  somewhat  overlapping  func¬ 
tions  and  behaviors. 
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Fleishman's  Taxonomy 

Fleishman  and  his  coworkers  (1966,  1975)  identified  a  number  of 
major  perceptual/ psychomotor  abilities  as  accounting  for  performance  in 
over  200  types  of  tasks; 

1.  Control  Precision- -muscular  adjustments  of  the  large 
muscle  groups,  e.g.  ,  arm-hand  and  leg  movements. 

The  ability  is  very  important  when  quick  and  precise 
adjustments  are  required. 

2.  Multilimb  Coordination- -involves  the  use  of  arm-hand 
and  leg  movements.  The  ability  is  involved  in  per¬ 
ceptual-motor  tasks  where  the  ability  to  coordinate 
the  movements  of  the  limbs  simultaneously  are  re¬ 
quired. 

3.  Response  Orientation- -the  ability  to  move  quickly  and 
correctly  in  response  to  a  stimulus. 

4.  Reaction  Time--the  time  elapsed  between  the  appear¬ 
ance  of  a  stimulus  and  the  response. 

5.  Speed  of  Arm  Movement--the  time  required  to  execute 
an  arm  movement,  where  accuracy  is  not  required. 

6.  Rate  Control  (Timing) --timing  motor  adjustments  in 
response  to  changes  in  moving  targets  or  objects. 
Compensatox-y  and  pursuit  movements  are  involved  in 
this  ability,  as  well  as  the  ability  to  respond  to  changes 
in  rate. 

7.  Manual  Dexterity- -the  ability  to  pei-form  tasks  involving 
the  manipulation  of  large  objects.  Skillful  arm -hand 
movements  undex-  speeded  conditions  are  also  involved. 

8.  Finger  Dexterity--the  ability  to  manipulate  small  ob¬ 
jects  with  the  fingers. 

9.  Arm-Hand  Steadiness --the  ability  to  make  accurate 
movements  involving  the  arm  and  hand.  Only  stead¬ 
iness  is  an  important  factor;  strength  and  speed  are 
not  involved. 

10.  Wrist-Finger  Speed  (Tapping)--the  ability  to  make 
rapid  wrist  flexing  and  finger  tapping  movements. 
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..  Extent  Flexibility- -forward,  backward,  and  lateral 
stretching  or  flexing  of  trunk  and/or  back  muscles. 

12.  Dynamic  Flexibility --the  ability  to  repeat  rapid  mus¬ 
cle  flexing  movements.  The  ability  is  critical  in  the 
recovery  from  strain  or  distortion. 

13.  Static  Strength- -the  force  exerted  against  objects  for 
a  brief  period  of  time.  The  ability  is  not  involved  in 
supporting  one's  own  body  weight. 

14.  Dynamic  Strength --muscular  resistance  to  fatigue. 

The  ability  involves  muscular  endurance  when  con¬ 
tinuous  muscular  force  is  required  over  a  consid¬ 
erable  period  of  time. 

15.  Trunk  Strength- -the  ability  involves  the  trunk  and 
abdominal  muscle  resistance  to  fatigue,  when  use 
of  these  muscles  is  required  over  a  considerable 
period  of  time. 

16.  Explosive  Strength- -the  ability  to  engage  in  activities 
requiring  short  bursts  of  energy  and  strength.  Con¬ 
tinuous  stress  or  strain,  through  repeated  exertion  of 
muscles,  is  not  involved. 

17.  Gross  Body  Coordination- -the  ability  to  coordinate  the 
actions  of  different  parts  of  the  body  while  simultane¬ 
ously  executing  gross  body  movements. 

18.  Gross  Body  Equilibruim--the  ability  to  maintain  body 
balance  while  opposing  forces  are  acting  on  the  body. 

19.  Stamina  (Cardiovascular  Endurance)--the  ability  to 
engage  in  physical  activity  and  expend  effort  over 
long  periods  of  time. 

Fleishman  and  his  colleagues  formulated  the  perceptual/ psycho¬ 
motor  abilities  and  their  definitions  through  a  series  of  interrelated  ex¬ 
perimental,  correlational,  and  factor  analytic  studies.  He  provided  (1967) 
an  example  of  his  experimental-factor  analytic  paradigm  by  describing 
the  process  in  the  development  of  the  Rate  Control  ability  factor.  He 
found  that  in  early  studies  this  factor  was  common  to  compensatory  as 
well  as  pursuit  tasks.  To  test  the  factors'  generality,  tasks  were  devel¬ 
oped  to  emphasize  rate  control.  The  factor  was  found  to  extend  to  such 
tasks.  In  later  studies  the  attempt  was  made  to  discover  if  emphasis  on 
this  ability  is  in  judging  the  rate  of  the  stimulus  as  distinguished  from 
ability  to  respond  at  the  appropriate  rate.  A  task  was  developed  to  in¬ 
vestigate  this  conjecture.  Performance  on  this  task  did  not  correlate 
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Table  2-2  (Cont.  ) 


5.  Skilled  Movements 

a. 

b. 

c. 

Simple 

Compound 

Complex 

Performing  tasks  of 
intricate  and  involved 
movement  based  on 
basic  movement  pat¬ 
terns 

Activities  which  builu  on  "Bas¬ 
ic  Fundamental  Movements 
(Category  2)  as  in  athletics, 
uancing,  and  painting 

6.  Nondiscursive 

a. 

Expressive 

Communicating  through 

Posture,  body  gestures,  gri¬ 

Communication 

movement 

body  movements  and 

maces,  sign  language,  and 

facial  expressions 

dance 

b. 

Interpretive 

movement 

a  Adapted  from  Harrow  (1972). 
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6.  Figure -Ground  Discrimination- -the  ability  to  se¬ 
lect  the  dominant  figure  from  the  surrounding 
background. 

7.  Perceptual  Constancy- -the  ability  to  recognize 
familiar  symbols  when  presented  in  a  novel  man¬ 
ner  or  size. 

8.  Auditory  Acuity--the  ability  to  discriminate  be¬ 
tween  sounds  of  pitch  and  intensity  differences. 

9.  Auditory  Tracking- -the  ability  to  locate  sounds 
and  track  their  direction  and  movements. 

10.  Auditory  Memory- -the  ability  to  recognize  and 
reproduce  (e.g.,  verbally)  past  auditory  experi¬ 
ences. 

Though  restricted  more  to  the  perceptual  side  of  perceptual/p 
chomotor  abilities,  Harrow's  10  abilities  can  be  included  in  a  more  c 
prehensive  list  of  perceptual/  psychomotor  abilities.  For  example,  tl 
can  be  included  with  Fleishman's  19  abilities,  which  emphasize  the  m 
tor  end  of  the  perceptual/ psychomotor  ability  dimension. 

Hunter's  Taxonomy 

Hunter  (1975)  defined  11  ability  factors  through  factor  analysis 
of  the  results  of  seven  perceptual/psychomotor  apparatus  tests  and  21 
paper-and-pencil  tests.  A  major  purpose  was  to  compare  the  factorial 
structure  of  apparatus  tests  with  the  factorial  structure  of  paper-and- 
pencil  tests.  The  results  showed  that  the  two  test  batteries  shared  little 
common  variance.  Six  ability  factors  were  specific  to  the  perceptual/ 
psychomotor  apparatus  battery,  four  factors  were  specific  to  the  paper- 
and-pencil  measures,  and  one  factor  was  common  to  both  batteries. 
First,  seven  factors  were  extracted  and  rotated  from  the  perceptual/ psy¬ 
chomotor  apparatus  battery  analysis:  (a)  Visual  Tracking,  (b)  Auditory 
Tracking,  (c)  Figural  Memory,  (d)  Position  Memory,  (e)  Motor  Speed, 

(f)  Associate  Speed,  and  (g)  Perceptual  Speed.  The  factors  were  defined 
by  those  apparatus  tests  (labeled  Test  1  to  Test  7)  which  loaded  highly 
(i.  e.  ,  >  4-  .30)  on  the  respective  factors  (Table  2-3). 

When  Hunter  factor  analyzed  the  combined  perceptual/psychomo- 
tor  apparatus  and  the  paper-and-pencil  batteries,  11  rotated  factors 
were  obtained  (Table  2-4):  (a)  Verbal,  (b)  Spatial  Relations,  (c)  Visual 
Tracking,  (d)  Figural  Memory,  (e)  Auditory  Hacking,  (f)  Mechanical, 

(g)  Associative  Speed,  (h)  Motor  Speed,  (i)  Manual  Dexterity  I,  (j)  Manual 
Dexterity  II,  and  (k)  Perceptual  Speed. 


1  1 


t  ^ 


1 1 1 ! .  1 1 •  •  ( 1  1  ' ;  i  <  • 1  <  >  r 

1’h\  cliomotiif 
raper-.ind-  1  'i 

Fable  2-4 

■  •  Obtained  l '  t ' » * t n  (  '.>nd>b.'*d 
/  Perceptual  ISattery  and 
m  il  Hatlenes  by  1  baiter 

! 

ac  tor 

Factor 

Variable  1 

o.nl  ing 

Var  iabl e 

Load ing 

Factor  1  (Verbal) 

Factor  11  (Spatial 

Re  la t ions) 

Word  Knowledge 

-.81 

Hidden  Figures 

.  PS 

Verbal  Analogies 

-  .  76 

Pattern  Detail 

.  t)  . 

Word  cl  rouping 

-.7  3 

Figure  Analogies 

.  6  1 

better  Sets 

- .  16 

Rotated  Blocks 

.  18 

Seale  Reading 

-.  15 

Electrical  Mace 

.  lo 

Electrical  Inforip.it  ion 

-.75 

Block  Counting 

.  A  .. 

table  Reading 

-.•70 

Point  Distance 

j  / 

Mechanical  !’r  ine  ip  less 

-.40 

Le  1 1  e  r  S.  t  s 

.  j 

Fii-ure  Analogies 

-.  !<’ 

Scale  Keati  ing, 

.  i  S 

i“st  6,  Concept  Identifica¬ 

Mechanical  Principles 

.  SI 

tion-Correct  Answers 

11 

Block  Counting 

-.  i  1 

Fac tor  111  (Visna 1 

Factor  IV  Figural 

Tracking) 

Memo  r  v ) 

Test  7,  Per  '  ortn.inc  i  Under 

Test  5,  Memory  Part  1 

Divided  Attent ion-bine 

(  Immed  iat.e) 

.  74 

F.rror,  Minute  7 

. 11 .! 

Test  1,  Memory  Part  J 

Test  7,  Periormance 

(Del  dyed ) 

.  71 

Under  Divided  Attention- 

Test  1.  Kinesthetic 

bine  Crror,  Minute  5 

.91 

Memo r v-Co r  r e c  t  An swe  r  t 

.  It. 

Test  /,  Periormance 

Test  3,  Performance 

Under  Divided  Attention- 

Under  Stress-Correct 

Lino  Error,  Minute  1 

.8-' 

Answers 

.50 

Test  7,  Performance 

Discriminat ion-Reac t Lon 

.49 

Under  Divided  Attention- 

Answer  Sheet  Marking, 

Line  Error,  Minute  A 

.88 

Rights 

.49 

Table  Reading 

.49 

Test  2,  Perceptual 

Speed -Response 

Time 

- .  46 

Test  2,  Perceptual 

Speed-Correct 

Answers 

.44 

Block  Counting 

.  37 

Point  Distance 

.  36 

Test  2,  Perceptual  Speed 

Perception  Time 

-.33 

Letter  Sets 

.  31 
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Table  2-4  (cont.  ) 


Factor  V  (Auditory 

Tracking  Factor  VI  (Mechanical) 


Test  7,  Performance  Under 

Tools 

-.75 

Divided  Attention-Tone 

Tool  Functions 

-.74 

Error,  Minute  2 

H 

00 

Electrical  Information 

-.62 

Test  7,  Performance  Under 

Mechanical  Principles 

-.55 

Divided  Attention-Tone 

Electrical  Maze 

-.31 

Error,  Minute  3 

.81 

Test  7,  Performance  Under 

Divided  Attention-Tone 

Error,  Minute  1 

.81 

Test  7,  Performance  Under 

Divided  Attention-Tone 

Error,  Minute  4 

.79 

Factor  VII  (Associative 

Factor  VIII  (Motor 

Speed) 

Speed) 

Test  4,  Associative  Learning 

Test  3,  Performance  Under 

Part  1 

O 

1 

Stress-Response  Time 

.85 

Test  1,  Kinesthetic  Memory- 

Test  2,  Perceptual  Speed- 

Response  Time 

.55 

Reseponse  Time 

.65 

Test  4,  Associative  Learning 

Part  2 

-.48 

Factor  IX  (Manual 

Factor  X  (Manual 

Dexterity  I) 

Dexterity  II) 

Answer  Sheet  Markings,  Wrongs 

.86 

Large  Tapping 

-.78 

Answer  Sheet  Markings,  Rights 

-.39 

Trace  Tapping  II 

-.71 

Test  2,  Perceptual  Speed- 

Answer  Sheet  Marking, 

Correct  Answers 

-.35 

Rights 

-.42 

Discrimination- React ion 

-.33 

Table  Reading 

-.33 

Factor  XI 

(Perceptual'  Speed) 

Test  3, 

Performance  Under 

Test  2,  Perceptual  Speed- 

Divided 

Attention-Perception 

Perception  Time 

.72 

Time 

.84  Test  6,  Concept  Identi- 

fi cat ion-Correct 

Answers 

-.33 

aTaken  from  Hunter  (1975). 
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Thus,  examining  the  factors  in  Table  2-3  and  Table  2-4  togei. 
er,  shows  that:  (a)  five  factors  are  predominantly  identified  by  appara¬ 
tus  tests  (i.  e, ,  Visual  Tracking,  Auditory  Tracking,  Motor  Speed,  As¬ 
sociative  Speed,  and  Perceptual  Speed),  (b)  five  factors  were  mostly 
identified  with  paper-and-pencil  tests;  Verbal,  Spatial  Relations,  Me¬ 
chanical,  and  Manual  Dexterity  (I  and  II),  and  (c)  one  factor--Figural 
Memory--was  identified  by  both  apparatus  tests  and  paper-and-pencil 
tests  nearly  equally.  Hunter  (1975)  claimed  such  a  factor  configuration 
was  encouraging  since  it  suggests  that  apparatus  tests  may  make  a 
unique  and  significant  contribution  (over  paper-and-pencil  tests)  to  the 
prediction  of  success  and  failure  in  technical  training  and  work.  Indeed, 
in  a  later  study.  Hunter,  Maurelli,  and  Thompson  (1977)  showed  sever¬ 
al  of  the  same  perceptual/ psychomotor  measures  as  predictive  of  per¬ 
formance  in  technical  training  schools. 


Rarick  and  Dobbins1  Taxonomy 

Another  perceptual/ psychomotor  ability  taxonomy,  based  on  fac¬ 
tor  analysis  of  a  group  of  tests,  was  reported  by  Rarick  and  Dobbins 
(1975).  As  did  Hunter,  they  described  four  perceptual/ psychomotor 
ability  factors  based  on  the  factor  loadings  of  each  test  on  each  factor 
(Table  2-5). 

Noting  that  the  Rarick  and  Dobbins  (1975)  taxonomy  contains 
more  gross  levels  of  abilities  than  does  Hunter's  (1975),  the  results  of 
any  factor  analytic  study  may  be  inferred  to  be  rather  situation  specific. 
The  number  and  types  of  tests  employed,  along  with  the  sample  of  sub¬ 
jects  used  and  conditions  of  testing,  limit  the  scope  and  definition  of  the 
factors  eventually  extracted.  To  increase  comprehensiveness  and  gen¬ 
erality,  additional  factor  analytic  studies  are  needed  which  examine  dif¬ 
ferent  tests,  different  subject  samples,  and  different  test  conditions. 

Applied  Psychological  Services'  Taxonomy 

At  Applied  Psychological  Services  (Pfeiffer,  Siegel,  Taylor,  & 
Shuler,  1978),  a  task  taxonomy  was  developed  to  categorize  tasks  on 
the  basis  of  their  perceptual/ psychomotor  ability  requirements.  The 
taxonomy  was  developed  with  reference  to  military  tasks  and  was  delib¬ 
erately  limited  to  categories  about  which  there  is  considerable  back¬ 
ground.  The  included  abilities  and  their  respective  definitions  are: 


I.  V ision- -the  ability  to  visually  detect  objects  and 
relations  among  objects  such  as  movement  or  re¬ 
lative  distances. 
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Table  2  - : ) 

The  i'ar  tor-Dol'ined  Components  oi l  h<  ■  Motor  Domain 
and  ‘he  VariabJ on  that  Best  I  iesi  rjbe  I  'hose 
l-'aetors  Aeoordiny  to  Kuriek  and  Dobbin:  (  llli'.i)  1 


i  '.o'!  or  ,\amt 


1.  m  r.-imlli- I  'oiv or- Body  Size 


2.  (Irons  Bodv  (  oordination 


2.  I  in.-  Motor  Abilities 


1.  Ha  I  a  tioo 


V  ■  i  J.i. 

VVoirld,  bod-,  dimensions,  i  i  >  ■  t :  • 
and  I  "b  :  iip  dy  na  mo; :  ).■(  o  r  .  *  re;,.  h 
bi-'>>  b'  oi'iiotno' or  (iiiinihoi-  <»'  r-  - 
\  ol  ii  i  ion: '  in  !)0  Mom  on  i .  ■ ,  t  ;<  .  . 

1 .  I>kp) 

IVrpendn  nlar  jump,  a  a  \  a :  d  .■■ms 
broad  jump,  s.-i a  inlilr,  lad  va;  i  : 

•\dap' od  Minnesota  Vlanipulai  i\  o, 
diit'  - 1  •board.  Two- i  ’late  l  ap'  in 
I  o  ,  i;  Ilia.  Star  kit!;’  I’est ,  (  .oil  Ho. 
Transfer  Tost 

bail  balmier  forward,  rail  baiair  e 
baoi.ward,  rail  balanro  side  wax .  , 
lea  b a  latli  t  • 


Adapted  I  rom  Kuriek  and  Dobbins.  (  1  ;t  V  a  ) 
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2.  Hearing- -the  ability  to  detect  significant  sounds 
amid  competing  sounds. 

3.  Strength --the  ability  to  move  objects  using  the 
body  and  limbs. 

4.  Impulsion--the  ability  to  react  quickly  to  light 
and  sound  by  making  explosive  movements  such 
as  tapping,  running,  and  jumping. 

5.  Motor  Speed- -the  ability  to  maintain  a  high  per¬ 
sonal  tempo  and  perform  accurately  using  arms, 
hands,  and  fingers. 

6.  Static  Precision--the  ability  to  maintain  good 
body  balance  and  arm  steadiness  while  aiming. 

7.  Dynamic  Precision- -the  ability  to  maintain  body 
balance  and  make  accurate  aiming  movements 
while  the  body  is  in  motion. 

Miscellaneous:  General  Test  Batteries 


The  final  set  of  perceptual/ psychomotor  ability  concepts  review¬ 
ed  here  concerns  those  attributes  measured  within  published  general 
test  batteries.  Five  major  test  batteries  were  identified  as  possessing 
relevant  perceptual/ psychomotor  ability  measures. 


General  Aptitude  Test  Battery  (GATB) 

The  GATB  was  developed  by  the  Fnited  States  Employment  Serv¬ 
ice.  It  was  constructed  primarily  for  vocational  and  employment  coun¬ 
seling  purposes,  and  includes  12  separately  timed  tests.  The  perceptual 
motor  ability  factors  included 

1.  Form  Perception--the  ability  to  perceive  per¬ 
tinent  detail  in  objects  or  in  pictorial  or  graph¬ 
ic  material;  to  make  visual  comparisons  and 
discriminations  and  to  see  slight  differences 
in  shapes  and  shadings  of  figures  and  widths 
and  lengths  of  lines. 

2.  Clerical  Perception- -the  ability  to  perceive 
pertinent  detail  in  verbal  or  tabular  material; 
to  observe  differences  in  copy,  to  proofread 
words  and  numbers,  to  avoid  perceptual  er¬ 
rors  in  arithmetic  computation. 


3.  Motor  Coordination--the  ability  to  coordinate 
eyes  and  hands  or  fingers  rapidly  and  accurate¬ 
ly  in  making  precise  movements  with  speed;  10 
make  a  movement  response  accurately  and  quick¬ 
ly. 

4.  Finger  Dexterity--the  ability  to  move  the  fingers; 
to  manipulate  small  objects  with  the  fingers,  rap¬ 
idly  or  accurately. 

5.  Manual  Dexterity- -the  ability  to  move  the  hands 
easily  and  skillfully;  to  work  with  the  hands  in 
placing  and  turning  motions. 

Differential  Aptitude  Tests  (DA  T) 

The  DAT  is  a  widely  used,  general  aptitude  test  battery.  1'nlike 
the  GATR,  the  DAT  was  developed  more  to  measure  vocational  aptitude 
than  to  aid  in  vocational  placement.  Consequently,  the  1)A1'  measures 
many  more  cognitive  and  "intellectual"  abilities  than  does  the  GATR. 
Of  eight  tests,  only  one  appears  to  measure  a  perceptual  or  psychomo¬ 
tor  factor:  Clerical  Speed  and  Accuracy- -the  ability  to  respond  quickly 
and  accurately  to  simple  visual  perceptual  tasks. 

Flanagan  Aptitude  Classifications  Tests  (FACT) 

The  FAC  T  was  developed  on  the  basis  of  actual  job  behaviors  and 
critical  work  incidents.  There  are  14  so-called  "job  clement"  tests  turn¬ 
ed  primarily  at  semiskilled,  skilled,  and  clerical  functions.  Fight  tests 
can  be  taken  as  measures  of  perceptual/ psychomotor  abilities: 

1.  Inspection  -  -the  ability  to  spot  flaws  or  imperfec¬ 
tions  in  a  series  of  articles  quickly  and  accurate¬ 
ly.  The  test  is  designed  to  measure  the  type  of 
ability  required  in  inspecting  finished  or  semi-fin¬ 
ished,  manufactured  items. 

2.  Coding- -the  speed  and  accuracy  of  coding  typical 
office  information.  A  high  score  can  be  obtained 
either  by  learning  the  codes  quickly  or  by  speed  in 
performing  a  simple  clerical  task. 

3.  Memory  -  -  the  ability  to  learn  and  remember  the 
codes  given  in  the  coding  test;  the  ability  to  mem¬ 
orize  printed  materials. 

1  U 
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.  Precis  ion --speed  and  accuracy  in  making  very 
small,  circular,  finger  movements  with  one 
hand;  and  with  both  hands  working  together.  The 
test  samples  the  ability  to  do  precision  work 
with  small  objects. 

5.  Seales--speed  and  accuracy  in  reading  scales, 
graphs,  and  charts.  The  test  measures  scale - 
reading  of  the  type  required  in  engineering  and 
similar  technical  occupations. 

6.  Coordination--the  ability  to  coordinate  hand  and 
arm  movements;  to  control  movements  in  a 
smooth  and  accurate  manner  when  these  move¬ 
ments  must  be  continually  guided  and  readjusted 
in  accordance  with  observations  of  their  results. 

7.  Patterns  -  -the  ability  to  reproduce  simple  pat¬ 
tern  outlines  in  a  precise  and  accurate  way. 
Part  of  the  test  requires  the  ability  to  sketch  a 
pattern  as  it  would  look  if  it  were  turned  over. 

8.  Components  -  -the  ability  to  identify  important 
component  parts.  The  samples  used  are  line 
drawings  and  blueprint  sketches.  This  perform¬ 
ance  represents  the  ability  to  identify  component’' 
in  other  types  of  complex  situations. 


Employee  Aptitude  Survey  (HAS) 


As  the  name  implies,  the  EAS  was  developed  specifically  for  in¬ 
dustrial  application,  in  particular,  employee  selection.  The  EAS  pos¬ 
sesses  10  short,  factor  analytically  derived  tests--three  of  which  can 
be  identified  as  measuring  perceptual/ psychomotor  attributes: 

1.  Visual  Pursuit--the  ability  1o  quickly  and  acc  u¬ 
rately  trace  lines  visually  through  an  entangled 
network. 

2.  Visual  Speed  and  Accuracy- -the  ability  to  see 
small  details  quickly  and  accurately,  as  requir¬ 
ed  in  visual  inspection  and  clerical  work. 

3.  Manual  Speed  and  Accuracy- -the  ability  to  make 
fine  finger  movements  rapidly  and  accurately. 
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G uilford-Zimmerman  Aptitude  Survey 

The  Guilford-Zimmerman  Aptitude  Survey  is  the  final  test  bat¬ 
tery  considered.  One  of  its  seven  tests  appeal’s  to  measure  a  perceptu¬ 
al/psychomotor  ability:  Perceptual  Speed- -the  ability  to  see  visual  de¬ 
tails  quickly  and  accurately  by  matching  identical  sketches  of  everyday 
objects. 


The  perceptual/ psychomotor  measures  within  each  of  the  five 
batteries  reviewed  provide  well  defined  attributes.  The  batteries  pos¬ 
sess  a  strong  research  data  base  and,  except  for  the  FACT,  define  their 
measures  through  factor  analysis.  As  with  Hunter  (1975)  and  Rarick 
and  Dobbins  (1975),  however,  ihey  are  not  comprehensive  taxonomic 
systems,  but  represent  a  few  selected  dimensions.  1'he  perceptual  abil¬ 
ities  are  operationally  defined  by  the  test  batteries  and  lack,  to  some  de¬ 
gree,  conceptual  meaning  outside  the  tests  themselves.  In  developing  a 
more  generally  useful  taxonomy,  the  value  of  the  test  measures  rests  in 
the  perceptual/ psychomotor  ability  concepts  that  can  be  derived  and 
adapted  independent  of  the  test  batteries. 

Suggested  Taxonomy  for  Determining  the  Perceptual/ Psychomotor 
Ability  Requirements  in  Selected  Air  Force  Specialties 

Taken  together,  the  literature  review  yielded  89  perceptual/ psy¬ 
chomotor  abilities  that  are  not  unique.  Added  to  this,  a  list  of  17  per¬ 
ceptual/psychomotor  abilities  which  are  representative  of  the  abilities 
required  for  task  performance  in  Air  Force  specialties  was  provided  as 
part  of  the  contract.  Accordingly,  a  total  of  108  perceptual/ psychomo¬ 
tor  abilities  was  on  hand  (Table  2-G),  from  which  a  final  taxonomy  was 
developed  for  employment  in  subsequent  phases  of  the  present  work.  The 
taxonomy  was  chosen  through  the  following  seven-step  procedure: 

1.  Identical  and  apparently  redundant  abilities  were 
combined  on  this  list;  31  items  were  thus  com¬ 
bined. 

2.  Vaguely  defined  and  grossly  categorized  abilities 
were  eliminated  from  the  list;  two  were  elminated. 

3.  Abilities  unrelated  to  the  perceptual/ psychomotor 
domain  and  nonrepresentative  of  t lie  ability  require¬ 
ments  in  Air  Force  career  fields  were  eliminated; 

12  were  eliminated. 
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Table  2-6 


.List  of  Perceptual/  Ps\  i  homotor  Attributes 


I  Berliner  (Rabideau,  1964) 

1.  Perceptual  Processes*5 

2.  Motor  Processes^ 


II  Fleishman  (1966) 

3.  Control  Precision 

4.  Multi  Limb  Coordination 

5.  Response  Orientation 

6.  Reaction  Time 

7.  Speed  of  Ann  Movement 

8.  Rate  Control  (Timing) 

9.  Manual  Dexterity* 

10.  Finger  Dexterity 

11.  Arm-Hand  Steadiness 

12.  Wrist-Finger  Speed  (Tapping) 

13.  Aiming  (Eye-Hand  Coordination) 

14.  Extent  Flexibility 

15.  Dynamic  Flexibility 

16.  Static  Strength 

17.  Dynamic  Strength 

18.  Trunk  Strength 

19.  Explosive  Strength 

20.  Cross  Body  Coordination 

21.  Gross  Body  Equilibrium 

22.  Stamina  (Cardiovascular  Endurance) 


III  Harrow  (1972) 

A.  23.  Segmental  Reflexes0 

24.  Inter-segmental  Reflexes0 

25.  Supra-segmental  Reflexes0 

26.  Locomotor  Movements0 

27.  Non-Locomotor  Movements0 

28.  Manipulative  Movements0 

29.  Kinesthetic  Discrimination 
30-  Visual  Discrimination 

31.  Auditory  Discrimination 

32.  Tactile  Discrimination 

33.  Coordinated  Abilities0 

34.  Endurance3 

35.  Strength 

36.  Flexibility 

37.  Agiiitv 

38.  Simple  Adaptive  Skill0 

39.  Compound  Adaptive  Skill0 

40.  Complex  Adaptive  Skill0 

41.  Expressive  Movement0 

42.  Interpretive  Movement0 
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Table  2-1)  (cont. ) 


8.  43.  Kinesthesis3 
44.  5 ody  Awareness0 
'.j.  Visual  Acui  ty 

46.  Visual  Tracking 

47.  Visual  Meoiorv 

48.  Figure  Ground  Discrimination 

49.  Pe.rceptuaJ  Constancy 

50.  Auditory  Acuity 

51.  Auditory  Tracking 
.*> 2 -  Audi,  t o v.  y  Memo  ry 


IV  Hvitei  (1975) 

53.  Vj.siia.1  TjacV  i**.#*' 

54.  Auditory  Tracking3 
55  Figural  Meuroy 

56.  Position  Me.no  ry 

57.  Motor  Speed3 

58  Associate  Speed 
59.  Perceptual  Speed 
60-  Gross  Manual  Dexterity* 

61.  Fine  M/imial  Dexterity* 


V  Racick  and  Dobbins  (1975) 

62 .  Sti  erigth-'Fowai— Body-Si  ze* 

63.  Gross  Body  Coordinat iona 

64.  Fine  Motor  Abilities3 

65.  Balance5 


VI  Pfeifrer,  Siegel,  Taylor,  and  Schuler  (1978) 

66.  Vision 

67.  Hearing 

68.  Strength3 

69.  Impulsion 

70.  Motor  Speed 

71.  Static  Precision 

72.  Dynamic  Precision 

VII  Miscellaneous:  General  Test  Batteries 

A.  GATB 

73.  Fora  Perception 

74.  Clerical  Perception 

75.  Motor  Coordination11 

76.  Finger  Dexterity3 

77.  Manual  Dexterity3 

B.  DAT 

78.  Clerical  Speed  and  Accuracy3 
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Table  2-6  (cont. ) 


c.  FACT 

79.  Inspection11 

80 .  Coding 

81.  Precision3 
8?.  Scales 

Q2.  Coordinationa 

84.  Patterns 

85.  Components3 

D.  EAS 

86.  Visual  Pursuit 

87.  Visual  Speed  and  Accuracy 

88.  Manual  Speed  and  Accuracy3 


E.  Guilford  Zimmerman  Aptitude  Survey 

89.  Perceptual  Speed3 


VIII  USAF  Representative  Perceptual  Motor  Abilities 

90.  Multi  Limb  Coordination3 

91.  Reaction  Time3 

92.  Control  Precision3 

93.  Race  Control3 

94.  Manual  Dexterity3 

95.  Finger  Dexterity3 

96.  Arm-Hand  Steadiness3 

97.  Wrist-Finger  Speed3 

98.  Aiming3 

99.  Depth  F reception 

100.  Near  Visual  Acuity 

101.  Far  Visual  Acuity 

102 .  Size  Percept iou 

103.  Sensory  Acuity 

104.  Color  Vision 

105.  Lang  Term  Memory 

106.  Short  Term  Memory 


Notes;  *  Hunter  (1975)  labels  these  a.c 
Manual  Dexterity  I  and  Manual 
Dexterity  II. 

a  E! iminated  in  Step  l  ot  Taxonomy 
Derivation . 

k  Eliminated  in  Step  ?  of  Taxonomy 
Deri  vat  ion 

c  Eliminated  in  Step  3  ot  'taxonomy 
De  rivation. 


4.  The  remaining  61  abilities  were  rated  on  the  fol¬ 
lowing  eight  criteria: 

a.  Compatibility --the  ability  should  be  fully 
compatible  with  the  Air  Force  task  struc¬ 
ture. 

b.  Under  stand  ability --the  ability  must  be 
readily  apparent  and  comprehensible  to 
Air  Force  users. 

c.  Objectivity --the  ability  should  allow  for 
standards  of  evaluation  which  are  free 
from  bias. 

d.  Scalability --the  ability  should  allow  for 
the  assignment  of  a  magnitude  value  (a 
number)  to  the  tasks  of  a  job  relative  to 
the  amount  of  the  ability  required  for  per¬ 
formance. 

e.  Validity- -the  ability  should  be  based  on 
acceptable  constructs,  relevant  to  Air 
Force  job  content,  and  seem  reasonable 
to  Air  Force  users. 

f.  Reliability--the  ability  should  be  amen¬ 
able  to  psychometrically  reliable  data  ac¬ 
quisition  methods. 

g.  Comprehensiveness- -the  ability  should 

be  applicable  to  the  full  range  of  tasks  in¬ 
volved  in  Air  Force  crreer  fields. 

h.  Unidimensionality --the  ability  should  be 
unique. 

Two  other  possible  criteria--practicality  and  cost- 
effectiveness--were  excluded  since  each  directly 
concerns  whole  taxonomic  systems  rather  than  the 
individual  abilities. 

Independent  ratings  of  each  remaining  perceptual/ 
psychomotor  ability  on  each  criterion  were  made 
by  two  psychologically  trained  and  experienced  rat¬ 
ers  who  possessed  knowledge  of  the  different  types 
of  Air  Force  career  fields  and  the  tasks  performed 
in  them.  The  ratings  were  made  on  a  5 -point  scale, 
where: 
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5  =  the  ability  fully  meets  the  criterion 
4  =  the  ability  largely  meets  the  criterion 
3  =  the  ability  meets  the  criterion  to  a 
mode  l  ate  extent 

2  =  the  ability  meets  the  criterion  mini¬ 
mally 

1  =  the  ability  hardly  meets  the  criterion 
at  all 

Both  the  order  of  the  abilities  and  the  criteria  on 
the  rating  sheets  were  altered  between  the  two 
raters. 

Although  each  ability  was  rated  on  eight  criteria 
(488  ratings),  a  degree  of  variation  which  was  use¬ 
ful  for  discrimination  between  abilities  existed  on 
only  two  criteria:  compatibility  and  comprehen¬ 
siveness.  Accordingly,  subsequent  steps  in  selec¬ 
tion  of  abilities  concerned  only  these  criteria. 

5.  The  independent  ratings  provided  by  the  two  raters 
on  compatibility  and  comprehensiveness  were  com¬ 
pared  to  determine  the  agreement  and  disagreement 
between  the  raters. 

Agreement  was  defined  as  a  difference  between  rat¬ 
ers  of  one  scale  point  or  less,  while  disagreement 
was  defined  as  a  difference  of  two  or  more  scale 
points.  All  rating  disagreements  were  resolved  in 
conference  by  the  two  raters.  There  was  a  total  of 
28  disagreements  out  of  a  possible  122  ratings  (2  x 
61)  and  hence,  77%  of  the  ratings  were  in  agreement 
as  defined. 

6.  The  ratings  were  summed  across  the  criteria  of 
compatibility  and  comprehensiveness  and  two  rat¬ 
ers  for  each  ability  (Table  2-7)  to  determine  the 
cutoff  points  which  included  the  top  rated  pereep- 
tual  abilities  and  top  rated  psychomotor  abilities. 


1 A  perceptual/ psychomotor  ability  was  classified  either  as  perceptual 
or  psychomotor  on  the  basis  of  its  emphasis  on  stimulus  or  response 
properties.  Those  abilities  more  concerned  with  the  stimuli  and  sen¬ 
sory  systems  were  labeled  perceptual;  those  more  involved  with  the 
response  were  called  psychomotor. 
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The  cutoff  point  for  the  perceptual  abilities  was  12, 
which  included  16  abilities;  for  motor  abilities  the 
cutoff  was  10,  which  included  17  abilities.  Table 
2-7  identifies  the  top-rated  perceptual  and  psycho¬ 
motor  abilities. 

7.  The  final  set  of  perceptual/ psychomotor  abilities 
was  selected. 

Both  raters  examined  each  of  33  top  rated  percep¬ 
tual/psychomotor  abilities  to  determine  their  over¬ 
all  acceptability  and  desirability  for  inclusion  in  the 
taxonomy. 

In  the  last  step,  the  raters  in  conference  examined  the  top-rat¬ 
ed  abilities,  as  well  as  the  lower-rated  abilities,  and  judged  each.  This 
process  led  to  the  elimination  of  several  top-rated  abilities  and  the  ad¬ 
dition  of  a  few  lower -rated  abilities.  Several  ground  rules  were  impos¬ 
ed  for  application  during  this  process: 

1.  Exclude  the  more  physical,  strength,  and  balance 
oriented  abilities. 

2.  Combine  similarly  defined  and  closely  related  abil¬ 
ities. 

3.  Include  more  specifically  defined  abilities  in  the 
place  of  grosser  and  more  broadly  defined  abil¬ 
ities. 

Together-,  the  judgments  and  decisions  brought  the  total  list  of 
abilities  down  to  13.  These  final  13  abilities  and  their  respective  defi¬ 
nitions  are  as  follows: 

1.  Control  Precision- -the  ability  to  perform  rapid, 
precise,  fine  controlled  adjustments  by  either  arm 
and  hand  movements  or  leg  movements. 

2.  Manual  Pexterity--tlie  ability  to  perform  skillful, 
well-directed  arm  and  hand  movements  to  manipu¬ 
late  either  fairly  large  or  fairly  small  objects  un¬ 
der-  speeded  conditions. 

3.  1'Tnger  Dexterity- -the  ability  to  perform  skillful 
manipulations  of  small  objects  with  the  fingers. 


Table  2-7 


Total  Sum  and  Sums  of  the  Compatibility 
and  Comprehensiveness  Ratings  by  Hater 


Control  Precision*3 

Multi  Limb  Coordination*3 

Response  Orientation*3 

Reaction  Time*3 

Speed  ot  Am  Movement*3 

Rate  Control  (Timing)*3 

Cross  Manual  Dexterity*3 

Finger  Dexterity*3 

Arm-Hand  Steadiness 

Wrist-Finger  Speed  (Tapping)*3 

Extent  Flexibility 

Dynamic  Flexibility 

Static  Strength*3 

Trunk  Strengch 

Explosive  Strength*3 

Cross  Body  Coordination*3 

Cross  Body  Equilibrium*3 

Dynamic  Strength*3 

Strength  *> 

Flexibi  1  ity 
Agility 

Kinesthetic  Memory 
Visual  Acuity3 
Visual-T  racking 
Visual  Memory 

Figure  Ground  Discrimination 

Perceptual  Constancy 

Auditory  Acuity 

Auditory  Tracking 

Auditory  Memory 

Figural  Memory 

Position  Memory 

Motor  Speed*3 

Associate  Speed 

Perceptual  Speed3 

tmpu Is  ton 

Stacie  Precision 

Dynamic  Precision 

V  is  ion3 

Hearing3 

Form  Perception33 
Cleriejl  Perception3 
Scales3 


Rater  1  Rater  2  Total 


7  7  14 

4  6  10 

4  5  9 

6  8  14 

5  7  12 

4  6  10 

10  8  18 

7  7  14 

6  7  13 

5  7  12 

3  4  7 

'•  5  9 

5  5  10 

4  5  9 

5  5  10 

7  7  14 

5  5  10 

5  6  II 

5  5  10 

5  6  11 

5  4  9 

4  6  10 

8  8  16 

4  6  10 

7  7  14 

6  4  10 

5  4  9 

5  5  10 

3  4  7 

4  4  8 

6  5  11 

4  5  9 

6  8  14 

5  6  U 

6  7  13 

5  5  10 

5  5  10 

3  '1  6 

8  7  15 

8  6  14 

7  f,  13 

b  6  1 2 

b  6  12 
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Table  2-7  (cont. ) 


Visual  Pursuit  5 
Visual  Speed  6  Accuracy3  7 
Depch  Perception3  7 
Near  Visual  Acuity3  9 
Far  Visual  Acuity3  8 
Size  Perception3  7 
Sensory  Acuity  6 
Color  Vision3  7 
Short  Term  Memory*5  8 
long  Terra  Memory*5  7 
Fine  Manual  Dexterity  *•  7 
Patterns  5 
Coding  9 
Aiming  4 
Kinesthetic  Discrimination  4 
Visual  Discrimination3  8 
Tactile  Discrimination  5 
Auditory  Discrimination3 _ 6 


3 

7 

5 

8 

7 

8 

6 
7 
7 
7 

7 
5 

5 

6 
6 

8 
6 
7 


8 

14 
12 
17 

15 
15 
12 

14 

15 
14 
14 
10 

9 

10 

10 

16 
11 
13 


a  top  rated  perceptual  abilities, 
b  top  rated  psychomotor  abilities. 
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4. 


Multilimb  Coordination--the  ability  to  coordinate 
the  movements  of  a  number  of  limbs  simultaneous¬ 
ly,  e.  g.  ,  two  hands,  two  feet,  and  hands  and  feet 
together. 

5.  Rate  Control  (Tracking)--the  ability  to  perform 
continuous  anticipatory  motor  adjustments  relative 
to  changes  in  speed  and  direction  of  a  continuously 
moving  object. 

6.  Visual  Speed  and  Accuracy- -the  ability  to  perceive 
small  details  quickly  and  accurately. 

7.  Visual  Memory--the  ability  to  recall  and  state  ver¬ 
bally  or  recall  and  reproduce  through  writing  and 
drawings  based  on  past  visual  experiences. 

8.  Position  Memory--the  ability  to  recall  rapidly  and 
accurately  the  position  of  objects  from  past  experi¬ 
ence. 

9.  Auditory  Discrimination--the  ability  to  discriminate 
and  interpret  sounds. 

10.  Auditory  Memory- -the  ability  to  recognize  and  re¬ 
produce  either  verbally  or  in  writing  prior  auditory 
experiences. 

11.  Clerical  Perception- -the  ability  to  read  or  copy 
rapidly  and  accurately  pertinent  details  in  scales, 
graphs,  or  charts. 

12.  Perception  of  Size  and  Form--the  ability  to  see 
slight  differences  in  the  size  and  shape  of  objects. 

13.  Depth  Per ception- -the  ability  to  determine  the  posi¬ 
tion  of  objects  in  space  and  to  perceive  in  three  di¬ 
mensions. 
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Measurement  Considerations 


Because  the  present  work  sought  to  apply  the  derived  taxonomy 
to  specific  Air  Force  specialties  and  tasks  within  specialties,  it  seem¬ 
ed  necessary  (a)  to  set  into  focus  any  measurement  problems  associat¬ 
ed  with  such  application  and  (b)  to  derive  a  scaling  method  for  quantify¬ 
ing  the  extent  to  which  each  skill  (taxonomic  category)  is  associated 
with  each  task. 

Theoretic  Issues 


"When  you  cannot  measure  it,  when  you  cannot  express  it  in 
numbers,  your  knowledge  is  of  a  meager  and  unsatisfactory  kind."  The 
positive  application  of  Lord  Kelvin's  dictum  has  enabled  the  psychologi¬ 
cal  sciences  to  progress  from  the  stage  of  observation  and  classifica¬ 
tion  to  one  of  ever-increasing  quantitativeness.  But  in  the  search  for 
quantitative  rigor,  the  investigator  has  often  found  that,  for  "numbers" 
to  be  meaningful,  there  is  a  requirement  for  constructing  a  scale. 

According  to  Ekman  (1968),  there  are  three  main  research  prob¬ 
lems  in  modern  psychophysics  and  scaling.  They  include  stimulus-re¬ 
sponse  relations,  psychophysiological  relations,  and  response -response 
relations. 

Stimulus  -  response  relations  belong  in  the  classical  Fechnerian 
tradition.  The  problem  here  is  to  establish  the  functional  relation  be¬ 
tween  the  stimulus  (S)  and  the  response  (R).  An  example  might  be  the 
relationship  between  judgment  of  elapsed  time  (R)  and  actual  elapsed 
time  (S). 

Psychophysiological  relations  have  been  studied  less  frequently 
than  S-R  relations.  An  example  of  a  psychophysiological  relation  is  the 
relationship  between  an  affective  response  and  the  corresponding  activ¬ 
ity  of  the  sensory  nervous  system. 

Response  -  response  relations  concern  the  functional  relationship 
between  subjective  variables.  In  this  case,  only  behavioral  or  psycho¬ 
logical  responses  to  variables  are  measured.  In  fact,  the  physical  con¬ 
tinuum  against  which  the  psychological  continuum  is  compared  may  be 
unknown  or  not  even  exist  as  a  measurable  scale.  In  an  early  article, 
Guilford  (1939)  contrasted  the  more  common  S-R  research  with  R-R 
research  and  pointed  to  the  importance  of  establishing  response -response 
relationships.  Relationships  between  perceived  task  attributes  and  per¬ 
ceived  training  requirements  are  examples  of  R-R  research.  Whim  do¬ 
ing  R-R  research,  the  development  of  such  a  scale  involves;  (a) definition 
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of  a  psychological  attribute,  (b) quantification  of  the  attribute,  and(c)es- 
tablishment  of  the  relationship  of  the  attribute  with  a  second  psychologi¬ 
cal  dimension.  Moreover,  it  is  necessary  not  only  to  quantify  the  psy¬ 
chological  attribute  but  also  to  specify  the  conditions  under  which  t tie 
quantification  may  hold.  Examples  of  perceived  dimensions  might  be 
estimated  training  time  required,  number  of  components  in  a  unit  or 
system,  ratio  of  satisfactory  to  unsatisfactory  job  performances,  esti¬ 
mated  time  to  perform  a  given  repair  or  replacement,  or,  in  the  pre¬ 
sent  case,  the  amount  of  a  specific  skill  required  to  perform  a  task. 


Scaling  Classes 


Regardless  of  the  type  of  problem  involved,  all  scaling  methods 
can  be  placed  into  one  of  three  classes.  The  classes  are  represented 
by  scaling  methods  designed  to  produce  an  ordinal  scale,  interval  scale, 
or  ratio  scale  of  measurement.  With  appropriate  transformations  and 
some  assumptions,  an  interval  scale  is  produced  by  such  methods  as 
paired  comparison  and  z  ank  order,  and  a  ratio  scale  is  produced  di¬ 
rectly  by  the  methods  of  magnitude  estimation  and  constant  sum. 


Representative  Scaling  Approaches 


For  the  purpose  of  assigning  the  extent  to  which  various  taxonom 
ic  categories  are  involved  in  Air  Force  tasks,  at  least  five  scaling  meth 
ods  are  possible. 

1.  The  rank  order  method  refers  to  a  procedure  in 
which  stimuli  are  hierarchically  arranged  by  an 
observer  along  some  continuum.  This  method  is 
distinctive  because  all  of  the  stimuli  to  be  catego¬ 
rized  are  present  for  simultaneous  observation. 
Application  of  the  method  results  in  a  category 
scale  or  an  interval  scale  (with  transformation). 

2.  The  paired  comparison  method  refers  to  a  pro¬ 
cedure  in  which  the  stimuli  to  be  evaluated  are 
presented  to  an  observer  in  all  possible  pairs. 

This  method  results  in  a  category  scale  or,  with 
the  statistical  treatment,  in  an  interval  scale.  An 
important  difference  between  such  category  meth¬ 
ods  as  paired  comparison  and  rank  order  is  that 
the  former  permits  the  same  category  to  be  used 
more  than  once,  whereas  the  latter  may  not. 
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3.  In  category  scaling,  the  judge  assigns  each  stim¬ 
ulus  to  one  of  a  number  of  discrete  categories 
which  form  a  continuum;  e.g.  ,  "always,"  "some¬ 
times,"  "never."  Any  number  of  categories  may 
be  employed,  but  five  or  seven  categories  are 
used  most  frequently.  The  result  is  an  ordinal 
scale  which  some  treat  as  an  interval  scale. 

4.  Magnitude  estimation  refers  to  a  procedure  in 
which  an  observer  makes  a  series  of  direct  nu¬ 
merical  estimates  of  subjective  impressions. 

Each  rater  is  presented  with  a  series  of  stimuli 
and  is  asked  to  assign  numbers  proportional  to 
the  apparent  magnitude  of  the  stimuli.  One  vari¬ 
ation  of  this  method  permits  all  stimuli  to  be  pre¬ 
sent  for  simultaneous  observation;  another  pre¬ 
sents  the  stimuli  one  at  a  time. 

5.  The  constant  sum  method  refers  to  a  procedure 
in  which  all  stimuli  to  be  evaluated  on  a  psycho¬ 
logical  scale  are  presented  to  an  observer  in  all 
possible  pairs.  The  task  is  to  divide  a  total  of 
100  points  among  the  members  of  the  set.  The 
immediate  numerical  result  of  this  procedure  is 
a  scale  value  for  each  stimulus  and  also  the  ra¬ 
tio  of  all  possible  pairs  of  stimuli  to  one  another. 

The  first  three  methods  are  indirect  or  category  approaches  to 
scaling,  whereas  the  fourth  and  fifth  methods  are  direct  or  magnitude 
approaches.  For  a  more  complete  treatment,  ihe  reader  is  referred 
to  Guilford  (1954)  or  Torgerson  (1958). 

Magnitude  methods  and  category  judgment  methods  seem  to  be 
the  mainstay  of  modern  scaling  applications.  New  methodological  devel¬ 
opments  have  been  few  (Cliff,  1973). 


Types  of  Continua 

Since  the  1957  article  of  Stevens  and  Galanter,  contemporary  psy¬ 
chophysics  has  faced  the  embarrassing  fact  that  the  two  classes  of  scal¬ 
ing  procedures  are  often  unable  to  produce  the  same  scale  of  sensory 
magnitude  (Galanter  &  Messick,  19(11).  According  to  Stevens  and  Galan¬ 
ter  (1957),  the  relation  between  category  and  magnitude  scales  is  nonlin¬ 
ear  for  one  class  of  perceptual  continua,  whereas  for  another  class  of 
perceptual  continua  the  relation  may  be  linear  (p.  377). 


Class  I  (prothetic)  continua  are  characterized  by  a  nonuniformity 
of  discriminal  sensitivity  along  the  entire  length  of  the  continuum,  i.  e., 
the  subject  is  more  sensitive  to  differences  at  the  low  end  of  the  scale 
than  at  the  high  end.  One  would  thus  expect  the  just  noticeable  difference 
between  stimuli  to  be  greater  at  the  upper  end  of  the  scale  than  at  the  low 
er  end  of  the  scale.  Class  I  probably  includes  the  dimensions  that  are  or 
dinarily  called  quantitative,  e.  g.  ,  length  and  weight  (Stevens,  1961). 

Class  II  (metathetic)  continua  are  characterized  by  a  uniform¬ 
ity  of  discriminal  sensitivity  along  the  entire  range  of  the  continuum, 
i.e.,  there  is  uniformity  of  discrimination  by  an  observer  over  the  en¬ 
tire  range.  One  would  thus  expect  the  just  noticeable  difference  to  re¬ 
main  approximately  constant.  Class  II  probably  includes  the  dimensions 
tine  are  ordinarily  called  qualitative,  e.g.  ,  pitch  and  visual  inclination 
(Stevens,  1961)  or  job  complexity  (Pfeiffer  &  Siegel,  1966a). 

For  Class  II  (metathetic)  continua,  the  category  scale  may  be  a 
linear  function  of  the  magnitude  scale,  whereas  on  Class  I  (prothetic) 
continua,  ore  scale  should  be  a  logarithmic  function  of  the  other  scale 
(Galanter  &  Messick,  1961). 

Relating  One  Scale  to  Another 

There  is  also  a  problem  when  data  derived  from  one  scaling  meth¬ 
od  are  related  to  those  derived  from  another  scaling  method.  Across- 
method  comparisons  do  not  always  yield  a  consistent  set  of  results. 

Generally,  most  studies  suggest  that  scales  obtained  by  the  cate¬ 
gory  methods  are  usually  logarithmic  transformations  of  ratio  estimation 
scales.  According  to  early  studies  cited  by  Ekman  and  Sjoeberg  (1965), 
these  results  have  held  true  even  for  stimuli  whose  physical  correlates 
are  quite  complex.  For  example,  Whitlock  (1.963),  who  evaluated  job 
performance,  found  his  data  to  satisfy  one  criterion  for  prothetic  contin¬ 
ua.  When  he  compared  category  and  magnitude  methods  on  a  continuum 
of  apparent  desirability  of  performance  of  employees,  a  concave  down¬ 
ward  curvilinear  function  was  obtained. 

More  recent  evidence  has  indicated  a  variety  of  relations  between 
ratio  and  category  scales.  While  John  (1969)  found  the  usual  logarithmic 
relation  between  category  ratings  and  magnitude  estimates  of  loudness, 
Sjoeberg  (1968a,  1968b)  found  linear  relations  among  magnitude  scales 
and  category  scales  of  facial  expressions  when  one  type  of  analysis  was 
performed  and  curvilinear  relations  in  another  study.  Gregson,  Mitchell, 
Simmonds,  and  Wells  (1969)  found  that,  when  two  anchors  were  given  for 
ratio  judgments  of  odors,  the  scale  acted  like  a  category  s  ale. 


Montgomery  (1975)  summarized  studies  in  which  the  importance 
of  methodological  differences  between  category  rating  and  magnitude  es¬ 
timation  was  examined.  In  one  study,  the  form  of  a  scale  obtained  by  a 
direct  estimation  procedure  was  found  to  vary  with:  (a)  the  range  of  re¬ 
sponses  actually  used  by  the  subject,  and  (b)  the  amount  of  freedom  in 
choosing  a  highest  number.  When  the  category  rating  and  a  magnitude 
estimation  task  were  procedurally  similar  in  both  respects,  the  result¬ 
ing  scales  were  linearly  related  to  each  other. 

Gibson  and  Tomko  (1972)  showed  that  category  and  magnitude 
scales  were  linearly  related  when  the  end  points  of  the  category  scale 
were  selected  in  such  a  way  that  they  coincided  with  the  previously  de¬ 
termined  range  of  magnitude  estimates. 

According  to  Montgomery  (1977),  given  a  constant  Weber  function 
for  the  category  scale,  the  category  scale  is  quite  close  to  the  Fechner 
integral  of  the  Weber  function  of  the  magnitude  scale.  From  this,  it 
might  be  inferred  that  the  general  psychophysical  differential  equation  is 
valid  for  the  relationship  between  category  and  magnitude  scales.  Fur¬ 
thermore,  according  to  Montgomery,  this  relationship  suggests  that  the 
category  scale  is  a  discrimination  scale.  Unfortunately,  the  assumption 
of  a  constant  Weber  function  for  category  scales  is  often  contradicted  by 
empirical  results.  The  standard  deviations  for  category  ratings  are  typ¬ 
ically  greatest  in  the  middle  and  decrease  toward  both  ends.  Eisler  and 
Montgomery  (1974)  suggested  that  this  discrepancy  between  theory  and 
empirical  data  could  be  explained  in  terms  of  bias  or  distortion  in  the 
Weber  function  of  the  category  scale.  Apparently,  extreme  stimuli  are 
discriminated  more  easily  than  stimuli  in  the  middle  range.  Clearly, 
additional  data  may  be  required  to  sort  out  the  principles  which  deter¬ 
mine  the  kind  of  relation  to  expect  between  category  and  magnitude 
scales. 

Siegel  and  Pfeiffer  (1966b)  attempted  to  sort  out  this  relationship. 
They  factor  analyzed  the  results  of  a  set  of  category  and  magnitude  scal¬ 
ings  of  technical  job  attributes.  Full  factorial  congruency  was  not  indi¬ 
cated.  Siegel  and  Pfeiffer  supported  the  use  of  the  paired  comparison 
method  over  the  rank  order  and  the  magnitude  estimation  methods.  It 
seems  as  if  the  judges  in  this  study  may  have  changed  their  frame  of  ref¬ 
erence  and  differentially  emphasized  discrimination,  boundary  mainte¬ 
nance,  and  perceptual  organizational  aspects  when  employing  these  latter 
methods. 

Eisler  (1962,  1963)  and  Eisler  and  Montgomery  (1974)  summar¬ 
ized  some  opposing  viewpoints  concerning  the  relationship  between  mag¬ 
nitude  and  category  scaler. 


One  view,  as  proposed  by  Stevens  (1957),  is  that  the  category 
scale  is,  in  effect,  a  distorted  magnitude  scale.  According  to  this  view, 
subjects  who  make  magnitude  judgments  are  influenced  by  the  variation 
in  ease  of  discrimination  at  the  low  and  the  high  ends  of  the  scale.  If 
ease  of  discrimination  varies  as  a  function  of  the  position  along  the  scale 
(low  to  high),  then  the  function  relating  category  to  magnitude  scales 
would  likely  be  logarithmic.  Thus,  proponents  of  this  view  try  to  ex¬ 
plain  away  any  differences  so  that  the  threat  to  a  single  psychophysical 
law  is  eliminated.  Stevens  (1962)  suggested  that  apparent  departures  from 
the  basic  law  might  lead  to  a  new  and  deeper  understanding  of  sensory 
metrics. 

The  opposing  view  regards  the  task  of  category  rating  as  obvious¬ 
ly  different  from  the  tasks  of  ratio  or  magnitude  estimation.  Emphasis 
is  placed  on  the  methodological  differences  inherent  in  the  category  and 
magnitude  procedures.  Proponents  of  this  view  suggest  that  the  category 
situation  yields  a  measure  of  the  subjects'  uncertainty  whereas  the  mag¬ 
nitude  method  results  in  an  estimate  of  subjective  magnitude.  Some  of 
the  variables  given  by  other  investigators  to  account  for  these  differences 
have  included  size  of  subjective  range  (Engen  &  McBurney,  1964;  Gibson 
&  Tomko,  1972),  spacing  of  stimuli  (Pradham  &  Hoffman,  1963),  the  sub¬ 
jects'  intent,  ability  to  discriminate,  and  expectations  (Stevens  &  Galant- 
er,  1957),  distortion  of  the  Weber  function  (Eisler  &  Montgomery,  1974), 
and  response  bias  (Schneider,  Parker,  Valenti,  Farrell,  &Kanow,  1978). 
According  to  Montgomery  (1975),  these  scaling  methods  differ  in  four  re¬ 
spects: 

1.  Rule  of  assignment  of  responses  to  subjective  magni¬ 
tudes.  This  factor  denotes  the  instructions  to  judge 
subjective  ratios  in  magnitude  estimation  versus  the 
instructions  to  judge  subjective  differences  (intervals) 
in  category  rating. 

2.  Openness  of  the  response  set.  By  openness  is  meant 
the  degree  of  freedom  given  to  the  subject  to  choose  a 
lowest  and  a  highest  number.  In  category  rating  there 
is  usually  no  openness,  whereas  in  magnitude  estima¬ 
tion  the  choice  of  a  lowest  and  a  highest  number  is  left 
to  the  subject. 

3.  Range  of  numbers.  This  factor  denotes  the  range  of 
numbers  between  the  lowest  and  the  highest  number 
used  by  the  subjects.  Usually,  the  range  of  numbers 
used  by  the  subject  in  magnitude  estimation  is  much 
wider  than  the  range  of  numbers  used  in  typical  cat- 
egory  rating. 
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4.  Discrete  versus  continuous  set  of  numbers.  In  cat¬ 
egory  rating,  the  subject  is  usually  allowed  to  use 
only  integers,  whereas  in  magnitude  estimation  all 
positive,  rational  numbers  are  permitted. 

The  results  of  Montgomery  (1975)  showed  that  the  form  of  a  scale 
varies  with:  (a)  the  range  of  responses  actually  used  by  the  subject,  and 
(b)  the  subject's  freedom  of  choosing  a  highest  number  as  a  response. 
The  other  factors  that  were  investigated  played  only  a  minor  role.  A 
narrow  range  and  fixed  upper  scale  value  yielded  the  typical  category 
scale,  whereas  a  wide  range  with  no  restriction  on  the  highest  value  pro¬ 
duced  the  typical  magnitude  scale. 

Invariance  When  Scaling  Job  Requirements 

A  case  in  which  the  relationship  between  category  and  magnitude 
scales  was  found  to  be  linear  was  demonstrated  by  Pfeiffer  and  Siegel 
(1966a).  In  their  study,  magnitude  and  category  scaling  methods  were  em¬ 
ployed  by  journeyman  electronics  personnel  to  scale  the  apparent  complex¬ 
ity  of  various  aspects  of  their  own  job.  The  resultant  data  indicated  that 
essentially  equivalent  scales  were  produced  across  the  methods  and  that 
the  continua  of  perceived  complexity  of  four  job  activity  stimuli  and  of  16 
electronic  circuit  stimuli  were  metathetic.  This  latter  conclusion  was 
based  on  the  relative  homogeneity  of  interindividual  discriminal  disper¬ 
sions  for  all  the  stimuli  and  also  on  the  linear  relation  between  the  scales 
resulting  from  category  and  magnitude  scaling  procedures.  The  absence 
of  large  distortions  as  the  result  of  the  introduction  of  different  methods 
suggested  support  for  a  single  psychophysical  law  in  the  avionics  job  per¬ 
formance  area.  Studies  supporting  scale  invariance  of  this  general  type 
have  also  been  demonstrated  in  academic  job  areas.  Pfeiffer  (1970), 
drawing  on  techniques  first  developed  at  Applied  Psychological  Services, 
used  both  a  magnitude  estimation  and  a  counting  procedure  to  determine 
the  requirements  of  college  professors.  American  and  European  students 
and  European  professors  were  used  as  subjects.  Correlations  between 
these  scales,  ranging  between  .95  and  .99,  indicated  strong  linear  rela¬ 
tionships  for  all  subject  groups  across  scaling  methods.  The  goodness  of 
fit  obtained  by  linear  procedures  in  conjuntion  with  supportive  data  on  uni¬ 
form  discriminal  dispersions  and  the  linear  R-R  relationships  suggest  a 
metathetic  continuum  for  the  range  of  values  investigated.  Moreover,  the 
consistency  of  these  investigations  about  the  continuum  of  job  complexity 
in  the  technical  job  areas  presented  suggest  that  this  type  of  R-R  scaling 
analysis  of  job  complexity  which  included  development  of  associated  phys¬ 
ical  correlates  could  be  done  well  in  advance  of  the  normal  system  devel¬ 
opment  cycle  and  by  subjects  with  diverse  backgrounds  (Siegel  A  Pfeiffer, 
1966a).  In  the  Siegel  and  Pfeiffer  (1966a)  study,  the  relationship  between 


electronics  job  activity  complexity,  as  perceived  by  maintenance  techni¬ 
cians,  and  the  scale  value  of  these  activities,  as  perceived  by  psycholo¬ 
gists  and  physicists,  was  investigated.  Guilford's  Structure-of-Intellect 
Model  (Guilford,  1967)  was  employed  as  referent.  Magnitude  estimation 
methods,  based  on  the  separate  and  independent  judgments  of  technicians, 
physicists,  and  psychologists,  were  employed  to  derive  the  required  da¬ 
ta.  Moderate  to  fairly  strong  relationships  were  found  between  the  scale 
values  of  the  intellective  factors  involved  in  the  job  activities  and  the  per¬ 
ceived  complexity  of  the  activities  for  all  subject  groups. 

Implications 

The  present  review  possesses  a  number  of  implications  for  the 
study  which  aims  to  investigate  perceptual/ psychomotor  factors  in  Air 
Force  specialties.  The  fact  that  psychological  scaling  may  not  always 
work  perfectly  should  not  be  taken  as  prima  facie  evidence  against  the 
use  or  invariance  of  such  scales  in  general.  A-Iany  cases  of  scale  invar¬ 
iance  have  been  reported- -particularly  for  metathetic  continua  (e.g.,  Ek- 
man  &  Kunnapas,  1963;  Pfeiffer  &  Siegel,  1966b).  However,  the  infor¬ 
mation  on  hand  suggests  that  such  scaling  should  be  performed  cautious¬ 
ly  ana  that  the  sensitivity  of  the  attribute  being  scaled  to  the  type  of  scal¬ 
ing  method  should  be  determined  prior  to  any  major  scaling  endeavor. 
Such  an  investigation  represents  an  early  step  in  the  present  effort.  If  it 
is  found  that  the  scaling  techniques  are  all,  with  minimal  error,  a  linear 
function  of  one  another,  the  selection  of  a  scaling  technique  for  employ¬ 
ment  can  be  based  on  considerations  that  are  other  than  methodological. 

If  the  customary  cost  and  time  criteria  are  employed,  a  categorical  or 
magnitude  estimation  method  would  appear  superior.  These  methods 
yield  values  which  can  be  used  directly. 

A  persistently  aggravating  problem  in  scaling  is  posed  by  the  fact 
that  each  judgment  is  affected  by  the  other  stimuli  being  judged.  Pairwise 
ratio  judgments  and  rankings  seem  most  likely  to  show  such  effects.  Un¬ 
fortunately,  context  effects  have  also  been  shown  to  occur  when  category 
scales  are  employed  (Cliff,  1973). 

A  strategy  which  has  considerable  historical  support  in  scientific 
practice  is  to  say  that  the  preferred  method  is  the  one  that  is  most  direct. 
Magnitude  and  categorical  scaling  have  this  virtue.  The  only  assumption 
is  that  the  observer  is  able  to  carry  out  the  instructions  to  quantify  per¬ 
ceptions.  Alternatively  stated,  this  means  that  the  subject  reacts  to  num¬ 
ber  stimulation  in  the  same  way  as  to  any  stimulation. 

Finally,  one  comforting  fact  is  t hat,  regardless  of  theoretic  is¬ 
sues,  psychological  scaling  of  job  tasks  on  attributes  has  been  shown  to 


yield  useful,  reliable  data.  In  a  study  completed  for  the  American  Tele¬ 
phone  and  Telegraph  Company  (Siegel  &  Federman,  1976),  a  variety  of 
craft  and  clerical  tasks  were  rated  by  job  incumbents  on  a  number  of  tax¬ 
onomic  attributes.  Adequate  between-r ater  reliability  was  achieved  and 
the  data  were  able  to  provide  a  basis  for  job  evaluative  techniques. 


III.  METHOD  DEVELOPMENT  AND  PRETEST 


With  the  ability  taxonomy  described  in  Section  II  on  hand,  a  meth¬ 
od  was  sought  that  would  allow  application  of  the  taxonomy  to  a  range  of 
Air  Force  career  fields  so  as  to  determine  whether  each  of  these  abilities 
is  involved  in  the  job  performance  of  these  career  fields  and  if  involved, 
the  extent  and  influence  of  the  involvement.  Accordingly,  some  type  of 
job  analysis  based  on  the  derived  taxonomy  seemed  indicated. 


Methods  of  Job  Analysis 


Job  analyses  have  been  conducted,  over  the  years,  using  a  varie¬ 
ty  of  data  collection  procedures.  The  relative  desirability  of  the  avail¬ 
able  methods  depends  on  a  number  of  factors.  Perhaps  the  most  impor¬ 
tant  consideration  is  the  goal  of  the  analysis.  At  the  general  level,  the 
goal  of  any  job  analysis  is  to  derive  information  which  describes  what  is 
done  on  the  job,  to  develop  information  relative  to  the  personal  attributes 
required  fo>"  job  performance,  or  to  derive  a  fuller  understanding  of  the 
job  itself.  The  derived  information  may  be  qualitative  or  quantitative ;  the 
information  may  be  molecular  or  molar. 


Direct  Observation  by  Analysis 


Job  analytic  data  may  be  collected  while  the  analyst  is  directly  ob¬ 
serving  performance  by  job  incumbents.  This  technique  may  appear  op¬ 
timal  in  that  it  affords  the  opportunity  to  question  the  job  incumbent  at  any 
stage  of  the  work.  It  allows  photographs  and  physical  and  temporal  meas¬ 
ures  to  be  taken  as  desired,  and  it  may  permit  the  analyst  to  perform 
some  or  all  of  the  job.  Data  collected  in  this  way  are  likely  to  be  objec¬ 
tive  and  accurate,  since  the  method  does  not  rely  on  the  job  incumbent's 
memory  or  expressive  ability.  Indeed,  direct  observation  is  often  con¬ 
sidered  the  superior  method  for  collecting  job  analytic  data  (Yoder  et  al.  , 
1958;  Bechtoldt,  1951).  However,  the  method  is  very  costly  in  terms  of 
analyst  and  job  incumbent  time,  if  all  portions  of  a  job  are  to  be  analyzed. 
The  presence  of  the  analyst  may  strongly  influence  the  behavior  of  the 
worker,  reducing  the  validity  of  collected  data,  and  the  results  of  apply¬ 
ing  the  method  can  be  influenced  by  the  analyst's  perceptivity.  The  tech¬ 
nique  may  be  applied  only  to  analysis  of  a  job  which  is  currently  being 
performed;  actual  equipment  and  sufficiently  experienced  personnel  are 
required,  as  is  the  continued  presence  of  a  perceptive  job  analyst.  Final¬ 
ly,  the  technique  is  suited  to  studies  of  the  overt,  observable  aspects  of 
job  performance,  but  may  not  be  effective  for  analyses  of  less  observable, 
underlying  variables  associated  with  job  performance  such  as  are  pre¬ 
sently  under  consideration. 
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Interview  Methods 


.lob  analytic  data  are  often  collected  through  interviews  with: 
single  job  incumbents,  groups  of  job  incumbents,  or  with  others  as¬ 
sumed  to  be  expert  with  respect  to  the  job  of  interest.  The  group  inter¬ 
view  approach  is  also  sometimes  called  the  technical  conference  tech¬ 
nique.  In  interview  techniques,  data  are  generally  collected  away  from 
the  job  site.  The  analyst  will  usually  follow  a  structured  or  semistrue- 
tured  interview  protocol.  The  goal  of  the  interview  may  be  to  collect  da¬ 
ta  descriptive  of  the  job  itself,  or  to  collect  data  concerning  some  under¬ 
lying  variable  or  set  of  variables,  such  as  required  aptitude,  skill,  train¬ 
ing  requirements,  or  work  pace.  Interview  techniques  may  be  expected 
to  be  relatively  inexpensive  to  apply,  and  they  may  yield  a  variety  of  job 
related  data.  Group  interviews  allow  immediate  review  of  data  accuracy 
by  the  entire  group,  and  the  data  may  be  collected  by  interview  when  the 
applicable  equipment  or  facilities  are  unavailable  or  not  in  existence.  On 
the  negative  side,  accuracy  and  completeness  of  collected  data  are  affect¬ 
ed  by  the  skill  of  the  interviewer  and  the  capabilities  of  interviewees  to 
communicate.  Data  collected  concerning  time  spent  on  tasks,  levels  of 
difficulty,  skills  required,  etc.,  may  be  affected  by  subjective  bias  or 
imperfect  memory  on  the  part  of  the  interviewee.  Data  obtained  from  su¬ 
pervisors  or  experts  may  tend  to  reflect  expectations  of  those  persons 
and  the  image  they  wish  to  present,  rather  than  actual  experience  or  be¬ 
havior  of  job  incumbents.  Additionally,  such  data  are  likely  to  be  color¬ 
ed  by  the  range  of  skills  and  experiences  held  by  the  expert  interviewee(s). 
The  interview  allows  the  acquisition  of  respondent  insights  beyond  a  sim¬ 
ple  categorical  reply.  It  allows  the  respondents  to  elaborate  more  fully 
on  their  responses  and  to  supply  their  own  points  of  view.  It  also  allows 
the  interviewer  to  probe  and  to  follow  up  on  areas  of  doubt,  concern,  or 
ambiguity.  Such  an  opportunity  can  only  be  minimally  provided  in  other 
methods.  However,  the  interview  is  an  interpersonal  interactive  situa¬ 
tion  and,  as  such,  is  subject  to  the  influence  of  such  situations.  More¬ 
over,  interviews  are  time  consuming,  and  open-ended  responses  are  sub¬ 
ject  to  interpretive  vagaries.  The  qualitative  data  emerging  from  in¬ 
terviews  are  often  more  difficult  to  treat  and,  if  content  analytic  meth¬ 
ods  are  involved,  an  additional  error  source  may  be  introduced. 
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Questionnaires  and  Task  Lists 


Collection  of  job  analytic  data  through  questionnaires  is  appeal¬ 
ing  due  to  its  economy  in  reaching  a  wide  number  of  incumbents/super  - 
visors.  Very  little  time  is  required  of  the  job  analyst  for  collection  of  the 
data.  However,  the  analyst  has  no  control  over  and  little  idea  of  the  at¬ 
tention  or  understanding  applied  in  completing  the  questionnaire.  As 
such,  job  analytic  questionnaires  are  subject  to  the  same  biases  as  any 
questionnaire.  The  results  may  be  biased  by  the  wording  of  the  set  of 
questions  employed  or  by  their  form.  The  response  rate  may  be  low  and 
problems  may  arise  in  analyzing  obtained  data. 

The  task  list  approach  is  a  variant  of  the  questionnaire  approach. 

In  the  task  list  approach  to  job  analysis,  a  list  of  the  tasks  performed  on 
the  job  is  presented  to  the  job  incumbents  or  their  supervisors.  They  are 
asked  to  complete  a  structured  set  of  ratings  relative  to  each  task.  The 
ratings  may  involve  how  frequently  each  task  is  performed,  how  hard  it 
is  to  learn  to  perform  each  task,  how  serious  the  consequences  of  inade¬ 
quate  performance  of  each  task  are,  how  complex  each  task  is,  the  length 
of  time  between  training  and  performance  of  each  task,  how  long  it  takes 
to  perform  each  task,  how  important  each  task  is,  or  whether  or  not  each 
task  is  performed  in  an  emergency. 

The  technique  has  received  extensive  investigation  and  applica¬ 
tion  within  the  Air  Force.  The  technique  has  also  been  adapted  by  at 
least  one  major  business  corporation,  where  it  has  been  employed  for 
training  requirements  and  organizational  structure  development  purposes 
(Siegel  &  Federman,  1976).  The  method  has  also  been  adapted  for  im¬ 
plementation  on  a  commercial  basis  by  at  least  one  industrial  consulting 
organization  (Lopez,  1978). 

Use  of  the  method  rests  on  the  availability  of  a  task  list.  The  de¬ 
velopment  of  such  a  list  depends  on  one  or  several  of  the  job  analytic 
methods  just  described.  However,  if  such  a  list  is  available,  the  task  list 
approach  is  comprehensive  and  economical,  and  the  results  are  amena¬ 
ble  to  a  variety  of  standard  statistical  manipulations.  If  the  list  is  admin¬ 
istered  through  the  mail,  there  is  little  control  over  the  quality  of  the  re¬ 
sponses,  the  diligence  of  the  respondents,  or  the  conditions  under  which 
the  form  is  completed.  However,  if  the  lists  are  taken  to  the  job  incum¬ 
bents,  these  problems  may  be  avoided  or  controlled  through  orientation¬ 
al  training,  administrator  diligence,  and  standardization  of  administra¬ 
tive  conditions. 


Daily  Diary 


In  the  daily  diary  approach  to  job  analysis,  workers  are  asked  to 
keep  detaiLed  records  of  their  daily  activities.  This  method  is  inexpen¬ 
sive  and  may  provide  accurate  data.  The  obtained  data  are  usually  in  a 
form  which  is  not  readily  amenable  to  statistical  analysis.  This  method 
seems  best  suited  only  to  determination  of  the  tasks  composing  a  job  and 
the  time  devoted  to  each.  Unless  the  workers  complete  the  diaries  dur¬ 
ing  the  course  of  their  work,  they  may  forget  some  details.  And,  com¬ 
pleting  such  a  diary  during  the  course  of  the  work  may  interfere  with  the 
work  itself.  Many  blue  collar  workers  do  not  feel  at  ease  with  this  meth¬ 
od  because  they  are  unaccustomed  to  any  written  expositional  task. 

Critical  Incident 


In  the  critical  incident  approach  to  job  analysis,  observers  record 
or  incumbents  art;  asked  to  describe  tasks  or  incidents  which  fall  at  the 
extremes  of  some  continuum  such  as  task  performance  time,  degree  of 
physical  demand,  or  degree  of  risk.  This  technique  is  not  useful  for  de¬ 
veloping  a  detailed  description  of  a  job,  factors  underlying  a  job,  or  re¬ 
quired  abilities  for  job  performance.  However,  the  technique  may  pro¬ 
vide  a  basis  for  recommendations  for  job  modification  or  redesign,  be¬ 
cause  the  data  elicited  by  the  technique  will  direct  attention  to  those 
aspects  of  a  job  which  are  extreme.  The  benefits  and  disadvantages  gen¬ 
erally  applicable  to  interview  and  observation  or  questionnaire  techniques 
of  job  analysis,  as  described  above,  apply  when  they  are  used  within  the 
critical  incident  approach. 


Comparison  of  Various  Approaches 


The  merit  of  each  described  job  analytic  procedure  relative  to 
various  characteristics  is  summarized  below: 


Direct  Observation 


Total 


interview  Methods 


-t  4 


-t  4 


Task  List/ Questionnaire  -t 


0  4  •+ 


Daily  Diary 


■4  4 


0  4  0  4 


Critical  Incident 


Tile  algebraic  sums  may  be  used  to  surest  roughly  an  order  of  merit 
for  the  various  techniques.  Of  course,  a  technique  must  be  selected  with 
consideration  jriven  to  the  type  of  information  desired,  the  ^oal(s)  of  the 
spe  ific  analysis,  the  information  already  available,  and  the  constraints 
of  '  he  situat  ion. 


Task  List  Method 


In  the  above  analysis,  the  task  list  method  appeared  to  be  a  pre¬ 
ferred  method  of  approach  within  the  present  study.  The  method  receiv¬ 
ed  the  highest  absolute  score.  The  task  list  method  is  highly  applicable 
as  a  technique  for  deriving  underlying  abilities- -a  fundamental  require¬ 
ment  of  the  present  work.  Moreover,  the  method  was  considered  to  be 
cost  effective,  would  interfere  minimally  with  ongoing  work,  and  would 
be  comprehensive,  quantitative,  and  objective.  Kelative  to  the  present 
program,  the  task  list  method  seemed  to  possess  the  following  advan¬ 
tages; 


1.  timeliness- -the  method  seemed  to  allow  achieve¬ 
ment  of  the  required  goals  within  the  required 
time  period. 

2.  compatibility- -the  method  is  compatible  with  cur¬ 
rent  Ail'  Force  practice. 

3.  balance- -the  method  seemed  to  allow  mutual  con¬ 
sideration  of  all  taxonomic  categories  with  no  cat¬ 
egory  being  unduly  emphasized  at  the  expense  of 
other  categories. 


Discussion  of  Task  List  Method 


The  task  list  method  of  job  analysis  makes  a  few  assumptions 
other  than  those  normally  assumed  for  am  quesiionniare.  Assuming  an 
understandable  task  list  and  set  of  instructions,  the  method  also  assumes 
that  the  person  completing  the  form  is  knowledgeable  about  the  job  anti 
can  accurately  report  that  knowledge.  Validity  coefi'nu'iv s  relative  to 
reporting  accuracy  were  found  by  Siegel  and  Muset 1 1  ( 1 97 o)  to  be  adequate¬ 
ly  high. 

Anyone  using  an  already  developed  list,  must  accept  the  compre¬ 
hensiveness  of  the  list  and  assume  the  job  lias  nol  e hanged  during  the  in¬ 
terval  between  initial  list  development  and  current  application.  Such  lists 
also  assume  that  the  sequential  ordering  of  the  tasks  is  not  a  significant 
factor  affecting  the  resultant  data  and  that  there  is  little,  if  any,  sequent  e- 
by-rafer  interaction.  Such  an  effect  run,  quite  obvious!  \  ,  be  balanced  b\ 
rotation  of  the  task  list  sequence  at  ross  raters. 

The  task  list  approach  lias  been  employed  by  the  Air  f  orce  m  sur¬ 
veys  of  a  number  of  task  characteristics,  ltn  hiding  I  roquets  \  of  task  per¬ 
formance,  amount  of  supervision  required  or  exert  used,  lask  t  omplexit;.  , 
training  or  knowledge  requirements-,  relative  'usk  difficulty,  exponent  e 


required  for  effective  performance,  importance  of  task  to  unit  mission, 
etc.  (Morsh,  1964).  The  Air  Force  has  found  that  task  lists  may  be  ad¬ 
ministered  economically.  According  to  Morsh,  test-retest  reliability  of 
such  lists  administered  by  mail  ranges  around  .70.  Also,  initial  studies 
of  validity  show  little  disagreement  between  data  provided  by  job  incum¬ 
bents  and  by  their  supervisors. 

Within  the  Air  Force  context,  Christal  (1974)  found  the  task  list 
approach  to  job  analysis  to  be  economical,  and  to  be  highly  quantifiable. 
Additionally,  the  approach  is  held  to  yield  data  which  may  be  readily 
stored,  manipulated,  analyzed,  and  reported  by  computer,  and  are  amen¬ 
able  to  tests  of  validity  and  stability  through  standard  statistical  methods. 

The  method  generally  assumes  that  the  rater  will  be  free  from  bi¬ 
as.  For  example,  a  bias  will  result  if  a  rater  rates  dishonestly.  There 
may  be  raters  who  are  openly  dishonest  or  hostile  to  the  rating  procedure 
or  job  being  evaluated.  Alternatively,  the  rater  may  be  uncommitted  to 
the  rating  task.  Campbell,  Durnette,  Lawler,  and  Weick  (1970)  suggest¬ 
ed  that  lack  of  rater  commitment  is  the  most  serious  source  of  rating  bi¬ 
as.  They  reasoned; 

The  most  serious  source  of  difficulty  (bias)  is  a  very 
fundamental  one  -  stemming  from  a  common  tendency 
for  psychologists  to  impose  their  ownbeliefs  about  job 
behavior  and  their  own  systems  for  recording  it  upon 
the  persons  whose  task  it  is  to  observe  that  behavior  .  .  . 

(It  is)  a  lack  of  understanding  and  a  lack  of  commit¬ 
ment  to  the  observational  (rating)  task  on  the  part  of 
observers.  As  a  consequence,  they  (the  observers) 
tend  to  fill  in  the  forms  (job  behavior  rating  scales) 
with  little  conviction;  the  records  contain  large  and 
for  the  most  pax-t  inestimable  errors  (p.  118-119). 

Error  due  to  lists  provided  and  error  due  to  the  configuration  of 
the  ability  structure  selected  represent  stimulus  error.  There  is  no 
doubt  that  a  stimulus  task  list,  which  is  not  objective,  unambiguous,  or 
complete  or  which  otherwise  does  not  incoi’porate  the  characteristics  of 
a  well-designed,  coherent  set  of  items,  will  be  less  than  fully  useful. 
However,  there  is  a  considerable  amount  of  information  available  about 
how  to  consti'uct  such  items,  how  to  present  them,  aixd  how  to  present 
clear  instructions  to  the  user.  These  sources  of  error  were  expected  to 
be  controlled  in  the  present  work  by  sufficient  care  and  attention  in  task 
item  writing  and  through  clear  rater  instructions  and  training. 
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Similarly,  the  error  introduced  because  of  the  configuration  of 
the  selected  ability  structure  was  to  be  reduced  by  providing  a  meaning¬ 
ful  ability  taxonomy  and  further  reduced  through  an  adequate  set  of  defi¬ 
nitions,  examples,  and  instructions. 

Pretest  Sample  and  Task  Sample 

After  the  task  list  approach  to  data  collection  was  tentatively  se¬ 
lected,  it  had  to  be  verified  before  employing  it  within  a  major  data  col¬ 
lection  effort.  Accordingly,  a  pretest  was  established.  The  specific  goals 
of  this  pretest  were  as  follows; 

1.  Identify  problems  inherent  in  the  anticipated  pro¬ 
cedures,  the  instruments,  and  the  measurement 
techniques. 

2.  Examine  relationships  between  rater  experience 
(i.  e.,  supervisor  versus  subordinate  ratings)  and 
obtained  information. 

3.  Assess  the  inter  rater  reliability  when  employing 
the  method. 

4.  Measure  consistency  of  responses  (test-retest  re¬ 
liability). 

5.  Serve  as  a  test  bed  for  determining  time  require¬ 
ments. 

(i.  Determine  the  sensitivity  of  the  obtained  data  to 
various  methods  of  scaling. 

Pretest  Sample 

To  accomplish  the  pretest,  two  career  fields.  Fire  Protection 
(571XX)  and  Munitions  Maintenance  (461XX)  were  selected.  The  consid¬ 
erations  behind  the  selection  of  these  career  fields  were  that  a  sufficient 
number  of  job  incumbents  seemed  available  at  each  of  two  air  bases  and 
that  each  career  field  represented  a  different  aptitude  area  (as  used  by 
the  Air  Force  for  classification  purposes).  Fire  Protection  is  classified 
ill  the  general  aptitude  area,  while  Munitions  Maintenance  is  a  mechani¬ 
cal  aptitude  area  specialty. 

The  job  incumbents  in  the  pretest  were  all  assigned  to  Egliu  and 
Homestead  Air  Force  Bases.  Supervisors,  i.e.,  pay  grades  of  E-(>  or 
above,  and  subordinates,  i.  e.  ,  pay  grades  of  H-T>  and  below,  were  sam¬ 
pled.  Table  3-1  describes  the  sample  b\  pay  grade  and  career  field. 
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Table  3-1 


Description  of  Pretest  Sample 

Pay  Grade 


Career  Field 

E-5  or  Below 

E-6  or  Above 

Total 

Fire  Protection  (571XX) 

24 

23 

47 

Munitions  Maintenance  (461 XX) 

22 

24 

46 

Total 

46 

47 

93 

Task  Sample 


In  an  effort  to  develop  pretest  task  lists  that  were  fully  repre¬ 
sentative  of  the  tasks  and  duties  performed  by  the  personnel  in  the  two 
career  fields.  Air  Force  Occupational  Survey  Reports  (OSRs)  were  con¬ 
sulted,  and  tasks  were  selected  in  accordance  with  the  following  task/ 
duty*  sampling  scheme: 

1.  Eliminate  tasks  and  duties  involving  only  super¬ 
vision,  planning,  and  training. 

2.  Eliminate  duties  performed  only  by  25  percent 
or  less  of  the  members  of  a  career  field. 

3.  Establish  a  target  list  length  of  20  tasks  for  each 
career  field.  Weight  the  duties  in  each  career 
field  in  accordance  with  the  following  weighting 
scheme: 


%  Performing  Weight 

75  or  more  4 

Between  50  and  74  3 

Between  26  and  49  2 


*  A  duty  is  a  set  of  related  tasks.  Tasks  are  grouped  under  duties  in  an 

OSR. 


Sum  the  weights  over  the  duties  included  and 
calculate  the  ratio  of  the  weighted  sum  in  each 
category  to  total  task  sample  size,  e.g.  ,  if  the 
sum  of  weights  over  all  duties  is  20  and  there 
a~e  two  duties  with  weights  of  four,  then  40 
percent  of  the  total  number  of  tasks  selected 
would  be  drawn  from  the  duties  with  the  weight 
of  four  (4  +  4  =  8;  8/20  =  40%).  If  the  calcula¬ 
tion  results  in  a  fraction,  add  a  task  to  the  duty 
with  the  largest  number  of  tasks,  within  the 
group  of  duties  with  the  same  weight. 

Table  3-2  presents  the  results  of  the  sampling  procedure  for  the  two  pre¬ 
test  career  fields. 


Development  of  Forms 

A  set  of  data  collection  forms  was  developed  to  allow  the  collec¬ 
tion  of  information  about  the  involvement  of  each  of  the  1 3  perceptual/psy¬ 
chomotor  abilities  in  each  task.  The  forms  were  prepared  separately  for 
each  career  field  but  the  forms  for  the  two  career  fields  were  similar  in 
format.  Each  form  contained  a  full  set  of  instructions  and  examples  of 
how  to  complete  the  form. 

Perceptual/ Psychomotor  Abilities 

The  13  abilities  contained  in  the  perceptual/ psychomotor  ability 
taxonomy  were  prepared  for  employment  in  the  pretest.  Several  modifi¬ 
cations  were  introduced  into  the  prior  definitions  in  order  to  make  them 
more  meaningful  to  the  anticipated  job  incumbent  raters.  Additionally, 
examples  of  activities  involving  each  ability  were  developed  for  each  de¬ 
finition.  For  each  ability,  two  examples  were  developed  to  typify  tasks 
in  which  a  "high"  amount  of  the  ability  is  required,  and  two  other  exam¬ 
ples  of  activities  were  developed  for  which  a  "low"  amount  of  the  ability 
is  required.  The  perceptual/ psychomotor  ability  definitions  list  used  in 
the  pretest,  along  with  the  examples,  follows: 

1.  Finger  Dexterity  (FD)--skillful,  coordinated,  precise  finger  move¬ 
ments  that  involve  the  use  of  one  or  more  fingers  to  achieve  quick 
and  accurate  manipulation,  insertion,  or  grasping  of  small  objects. 

Examples : 

High  1.  Typing  requires  rapid  movement  of  several 
fingers  to  perform  a  sustained,  coordinated 
activity. 


Table  3-2 


Task  Sampling  Procedures  for  Pretest  Career  Fields 


Duty  Sample 

Munitions  Maintenance  (461XX) 

%  Performing  Weight  * 

No.  of  Tasks  ** 

C 

95 

4 

3 

E 

91 

4 

3 

F 

49 

2 

2 

G 

27 

2 

1 

H 

67 

3 

3 

I 

64 

3 

3 

J 

33 

2 

1 

M 

60 

3 

2 

N 

48 

2 

2 

Z  -  25 

*  Ratio  of 

weight 

to  sample  size;  4: 

8/25  =  32%,  3 

:  9/25  =  36%, 

2:  6/25  - 

32% 

**  Number  of 

tasks 

to  be  sampled  from 

each  weighted 

category; 

4:  32%  x 

20  =  6 

,  3:  36%  x  20  *  8, 

2:  32%  x  20  = 

6 

Fire  Protection  (571XX) 

Duty  Sample 

%  Performing 

Weight  * 

No.  of  Tasks  ** 

C+ 

37 

2 

— 

E 

62 

3 

1 

F 

83 

4 

2 

G 

55 

3 

1 

H 

53 

3 

1 

I 

63 

3 

1 

J 

71 

3 

2 

K 

71 

3 

2 

L 

70 

3 

2 

M 

66 

3 

1 

N 

79 

4 

1 

0 

82 

4 

2 

P 

30 

2 

1 

Q 

47 

2 

1 

R+ 

28 

2 

- 

S 

35 

_2 

2 

E  =  46 

+  The  OSRs  did  not  contain  task  related  data  for  Duties  C  and  R  due  to 
very  low  percentage  data.  Replacement  tasks  were  selected  from  other 
duties  in  the  same  weight  category  (Duty  Q,  by  this  procedure,  should 
have  had  two  tasks  sampled  but  the  OSR  reported  only  one  task) 

*  Ratio  of  weights  to  sample  size;  4:  12/46  ■  26%,  3:  24/46  ■  52%, 

2:  10/46  -  22% 

**  Number  of  tasks  to  be  sampled  from  each  weighted  category; 

4:  26%  x  20  -  5,  3:  52%  x  20  -  11,  2:  22%  x  20  -  4 
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2.  Painting,  drawing,  and  lettering  require  the 
accurate  manipulation  of  an  implement. 

Low  1.  Pulling  the  trigger  on  a  revolver  requires 
little  finger  dexterity  because  only  one  fin¬ 
ger  is  used  in  a  relatively  uncoordinated  ac¬ 
tion. 

2.  Activating  a  light  switch  is  low  on  finger 
dexterity  because  only  a  finger  and  thumb 
(or  finger  alone )  are  used  to  throw  the  switch 
and  no  precision  is  required  to  position  the 
switch. 

2.  Manual  Dexterity  (MD)--skillful.  well-directed,  coordinated  arm  and 
hand  movements  to  manipulate  objects  quickly  and  accurately  (but, 
not  controlling  a  machine). 

Examples: 

High  1.  Assembling  a  radio  because  parts  and  tools 
must  be  manipulated  accurately,  carefully, 
and  in  a  coordinated  manner. 

2.  Welding  a  patch  in  an  aircraft's  skin  requires 
a  high  degree  of  skillful  arm  and  hand  manip¬ 
ulation. 

Low  1.  Closing  a  door  is  low  in  manual  dexterity  be¬ 
cause  there  is  little  directed  activity  or  coor¬ 
dination  involved. 

2.  Grasping  pliers  to  hold  an  object  requires  some 
manual  dexterity,  but  little  skilled  movements 
or  coordination  of  the  arm  and  hand. 

3.  Control  Precision  (CP)--rapid,  precise  adjustments  by  an  arm,  hand, 
(individually  or  simultaneously)  to  a  machine's  control  mechanism 
(e.g. ,  levers,  pedals).  The  adjustments  do  not  involve  objects  (e.g.  , 
pencils,  tools,  electronic  parts). 

Examples : 

High  1.  Fine-tuning  a  radio  dial  requires  control  pre¬ 
cision. 

2.  Manipulating  the  gas  pedal  in  an  automobile 
requires  control  precision  because  a  car  is 
highly  sensitive  to  slight  changes  in  the  pres¬ 
sure  applied. 
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Low 


1.  Operating  an  on-off  switch  requires  minimum 
precision  in  going  from  one  position  to  the 
other. 

2.  Activating  the  high  beam  lights  of  a  car  with 
the  foot  control  requires  a  low  level  since  it 
is  accomplished  with  a  single  depression  and 
no  adjustments  or  precision  are  required. 


4.  Rate  Control  (Tracking)  (RC)- -continuous  and  accurate  arm,  hand, 
or  leg  control  adjustments  to  changes  in  the  speed  and/or  direc¬ 
tion  of  continuously  moving  objects.  The  purpose  is  to  intercept, 
control,  or  follow  a  moving  object. 


Examples : 

High  1.  Tracking  a  target  on  a  cathode  ray  tube  (CRT) 
by  keeping  the  target  inside  a  cursor  (circle) 
requires  fine  control  adjustments  to  quickly 
moving  targets  that  move  in  several  dimen¬ 
sions. 

2.  Auto  driving  requires  continuous  within-tol- 
erance  adjustments  of  the  steering  wheel. 


Low  1.  Illuminating  a  slowly  moving  object  with  a 
flashlight  requires  little  rate  control  be¬ 
cause  the  speed  of  movement  is  low  and  the 
performance  tolerances  are  high. 

2.  Walking  with  others  requires  a  low  amount 
because  speed  will  vary  s lightly  and  the  move¬ 
ment  is  in  a  readily  predictable  direction. 


5.  Visual  Memory  (VM)--recall  of  things  which  have  been  seen  in  the 
past  and  expressing  the  recalled  visual  information. 


Examples: 

High  1.  Identifying  a  needed  spare  part  in  a  group  of 
parts  on  the  basis  of  appearance  requires  the 
ability  to  recognize  the  spare  part  and  specify 
it  by  name  and/or  number. 

2.  Recalling  the  appearance  of  a  given  aircraft 
type  requires  memory  for  visual  information. 


Low  1.  Entering  parts  replaced  on  a  maintenance  form 
requires  a  low  level  because  the  appearance  of 
the  parts  does  not  have  to  be  remembered  or  ex¬ 
pressed. 
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2.  Scheduling  work  assignments  requires  a  low 
level  because  the  appearance  of  the  persons 
to  be  assigned  does  not  have  to  be  remem¬ 
bered. 

6.  Visual  Speed  and  Accuracy  (VSA)--seeing  small,  fine  details  quick¬ 
ly  and  accurately.  It  includes  seeing  differences  in  size  and  shape. 


Examples; 

High 

1. 

Inspecting  a  part  for  rust,  chips,  mars, 
scratches,  or  marks  requires  the  ability 
to  see  fine  details  quickly.  No  recall  is 
involved. 

2. 

Examining  and  separating  fingerprints  quick¬ 
ly  requires  the  ability  to  distinguish  size  and 
shape  of  fine  details  in  a  limited  time  period. 

Low 

1. 

Washing  an  aircraft  because  the  visual  ac¬ 
tions  to  be  performed  are  quite  gross. 

2. 

Inspecting  cargo  for  shipping  size  restric¬ 
tions  requires  a  low  amount  because  the  de¬ 
tails  are  gross  and  few  time  restrictions 
exist. 

7.  Position  Memory  (PM)--recalling  rapidly  and  accurately  the  position 
of  objects  from  past  experience.  Emphasis  is  on  recalling  the  posi¬ 
tion  or  location  of  where  objects  belong  without  having  to  express  it. 


Exa.  nples : 

High 

1. 

Performing  a  preflight  inspection  because 
the  location  of  the  items  to  be  inspected 
must  be  recalled. 

2. 

Locating  a  part  in  an  aircraft  as  the  result 
of  a  prior  experience  with  the  part. 

Low 

1. 

Fueling  an  aircraft  because  the  fueling 
points  are  quite  obvious. 

2. 

Filing  requires  a  low  level  of  position  mem¬ 
ory  because  the  alphabetical  sequencing  is 
obvious. 
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8.  Auditory  Discrimination  (AD)- -distinguishing  sounds  and  interpreting 
them. 

Examples: 

High  1.  Detecting  and  determining  a  malfunction  in 
a  motor  on  the  basis  of  the  sounds  of  the 
motor. 

2.  Interpreting  Morse  code. 

Low  1.  Listening  to  a  pipe  to  determine  if  water  is 
flowing  through  it  involves  a  low  level  of 
auditory  discrimination  because  the  sound 
is  distinctive  and  the  discrimination  is  gross. 

2.  Determining  whether  or  not  a  motor  is  run¬ 
ning  requires  a  low  level  since  there  are  on¬ 
ly  two  choices,  on  or  off,  and  the  sound  of  a 
running  motor  is  quite  identifiable. 

9.  Auditory  Memory  (AM)--remembering,  recognizing,  and  reproducing 
the  characteristics  of  sounds.  This  ability  does  not  involve  interpre¬ 
tation  of  the  sounds. 

Examples: 

High  1.  Recognizing  a  navigational  tone  in  the  pre¬ 
sence  of  conflicting  signals  and  describing 
the  sounds  verbally. 

2.  Explaining  the  characteristics  and  distin¬ 
guishing  features  of  an  emergency  signal. 

Low  1.  Describing  radio  static  on  a  maintenance 
form. 

2.  Identifying  thunder  during  an  electrical 
storm. 

10.  Clerical  Perception  (CLP)--rapid  and  accurate  reading  or  copying  of 
details  in  scales,  graphs,  charts,  or  tables. 

Examples : 

High  l.  Copying  a  long  list  of  numbers  from  a  tele¬ 
phone  directory. 

2.  Obtaining  information  from  a  detailed  parts 
replacement  stock  list  requires  a  high  level. 


Low  1.  Standing  guard  duty  at  the  base  entrance  and 

noting  numbers  from  automobile  license  plates. 

2.  Reading  organizational  charts. 

11.  Depth  Perception  (DP)--determining  positional  relationships  among 
objects  in  space. 


Examples : 
High 


1.  Operating  an  aircraft  in  a  congested  area  re¬ 
quires  a  high  amount  due  to  the  involved  ar¬ 
rangement  of  the  aircraft  in  space. 

2.  Flying  in  formation 

1.  Loading  an  aircraft  with  cargo. 

2.  Attaching  an  auxiliary  power  unit  (APU)  to 
an  aircraft. 


12.  Divided  Attention  (DA)--receiving  and  using  information  from  more 
than  one  source  at  the  same  time. 


Examples: 


1.  Monitoring  and  directing  aircraft  in  the  con¬ 
trol  tower  based  on  information  received  from 
the  radio  and  the  radar  requires  a  high  level 
because  of  the  simultaneous  use  and  integra¬ 
tion  of  complex  information  from  more  than 
one  channel. 

2.  Flying  an  aircraft  under  instrument  flight  reg¬ 
ulations  (IFR)  conditions  because  various  in¬ 
struments  must  be  read,  a  radio  must  be  mon¬ 
itored,  and  the  aircraft  controlled  at  the  same 
time. 

1.  Testing  an  electronic  equipment  on  the  basis  of 
a  meter  and  a  sound  signal  requires  a  low  level 
because  although  two  channels  are  involved,  the 
operator  can  shift  easily  from  one  to  the  other. 

2.  Supervising  several  subordinates  requires  a  low 
level  because  the  supervisor  is  not  dependent  on 
receiving  the  information  simultaneously. 


13.  Kinesthetic  Memory  (KM)--manipulating  objects  without  benefit  of 
visual  guides  or-  indications. 


Examples: 

High  1.  Replacing  screws  in  places  that  are  not  insight, 
such  as  under  a  dashboard,  requires  a  high 
amount  of  the  ability  since  the  actions  cannot  be 
observed  and  a  blind  positioning  action  is  involv¬ 
ed. 

2.  Attaching  a  fitting  to  the  pipe  under  a  sink  re¬ 
quires  a  high  level  because  visual  guides  are  not 
available  during  the  manipulations. 


Low  1.  Screwing  a  light  bulb  into  a  socket  in  a  dark  room 
requires  a  low  amount  of  kinesthetic  memory  be¬ 
cause  the  relationship  is  quite  obvious. 

2.  Inserting  a  key  into  a  keyhole  in  a  dark  room  re¬ 
quires  a  low  amount  because  the  manipulation 
of  the  object  is  limited.  Only  an  insertion  is  in¬ 
volved. 


Perceptual/ Psychomotor  Ability  Requirements  Questionnaires 

To  provide  a  basis  for  achieving  the  overall  pretest  goals--evalu- 
ation  of  the  task  list  questionnaire  method  of  data  acquisition  and  the  util¬ 
ity  of  the  taxonomy--two  data  types  were  relied  on:  (a)  how  much  each 
ability  is  involved  in  the  performance  of  each  task  (amount)  and  (b)  the 
variability  in  the  quality  of  task  performance  as  a  function  of  each  specif¬ 
ic  ability  (performance  quality  variability).  The  first  data  type  provides 
a  measure  of  the  relative  saturation  of  a  perceptual/ psychomotor  ability 
in  the  performance  of  a  task,  and  by  summary  in  the  performance  of  the 
career  field.  The  second  data  type  provides  an  indication  of  whether  or 
not  the  ability  separates  good  from  poor  task  performers. 

Each  data  collection  instrument  was  divided  into  two  sections. 
The  first  was  called  "Amount  of  Perceptual/ Psychomotor  Ability";  the 
other  was  titled  "Performance  Quality  Variability  as  a  Function  of  Per¬ 
ceptual/Psychomotor  Ability." 

Each  section  was  further  divided  into  two  parts--one  part  requir¬ 
ed  a  categorical  response  while  the  second  required  a  magnitude  estima¬ 
tion.  The  survey  respondents,  thereby,  yielded  an  evaluation  of  each 
task  twice  in  each  section  of  the  form--once  using  a  category  scale  and 
again  using  a  magnitude  estimation  scale. 
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For  the  categorical  estimations,  a  five -point  category  scale  was 
used.  The  range  of  categories,  in  the  amount  section,  was  from  "1" 
(very  little)  through  "5"  (very  much),  with  the  scale  value  of  "3"  (mod¬ 
erate)  anchoring  the  midpoint.  The  scale  appeared  on  a  card  which  the 
respondents  referred  to  while  completing  the  form  and  also  in  the  ap¬ 
propriate  set  of  instructions.  Two  other  qualitative  responses  were  in¬ 
cluded:  N  -  not  performed  in  your  squadron  and  NR  =  performed,  but 
ability  not  required  in  task  performance. 

The  magnitude  estimation  scale  provided  greater  freedom  of  re¬ 
sponse.  The  scale  ranged  from  0  to  100,  and  allowed  the  option  of  se¬ 
lecting  any  intermediate  value.  Qualitative  descriptive  anchors  were 
placed  under-  the  scale  of  values  at  five  levels.  The  instructions  to  the 
two  sections  and  the  two  parts  within  each  section  of  each  questionnaire 
are  presented  in  Appendix  A  to  this  report. 

Pretest  Administration 

An  Applied  Psychological  Services  staff  member-,  who  was  in¬ 
volved  in  their  preparation,  administered  the  forms  at  the  two  Air 
Force  bases  involved.  I'he  survey  sessions  were  conducted  in  classroom 
situations.  About  12  to  25  respondents  participated  in  each  data  collec¬ 
tion  session. 

The  person  who  performed  the  form  administration  was  experi¬ 
enced  in  data  collection  techniques  in  the  military  and  was  knowledgeable 
of  the  perceptual/ psychomotor  taxonomy  and  the  job  analytic  concepts. 

Administrator's  Training 

A  set  of  administrator  instructions  was  prepared  for  and  review¬ 
ed  by  the  administrator  prior  to  his  air  base  visits.  I’he  instructions 
presented  a  standardized  procedure  for  the  administration.  All  perti¬ 
nent  procedural  steps  were  outlined  in  the  instructions.  This  allowed  the 
administration  to  proceed  in  a  consistent  manner  across  sessions. 

I’he  administrator  instructions  suggested  the  points  to  cover  in  a 
briefing  period  which  preceded  the  respondents'  completion  of  the  forms. 
Additionally,  the  instructions  suggested  an  administrative  style  and  atti¬ 
tude  which  would  be  both  helpful  and  motivating  to  the  respondents. 


Administrator  Instructions 


Assemble  the  group 

Distribute  the  following 

•  forms  by  AFSC  number  (right  corner  of  cover  page) 

•  definitions  list 

•  pencils 

Introduction 

•  your  name 

•  give  company  name  and  geographic  location 

•  indicate  that  Applied  Psychological  Services  is  under 

contract  to  the  Air  Force  Human  Resources  Labora¬ 
tory,  Brooks  Air  Force  Base,  to  conduct  this  research 
program  v 

Purpose  of  research  program 

•  to  evaluate  the  abilities  required  in  different  Air-  Force 
jobs  (i.  e.  ,  the  sensory  and  manipulative  aspects  of  the 
job,  the  things  people  do,  and  the  performance  aspects 
of  the  job) 

•  the  data  will  be  used  specifically  to  help  the  Air  Force 
determine  job  performance  requirements 

•  the  global  purpose  is  to  improve  the  entire  career  de¬ 
velopment  program  in  the  Air  Force 

Why  respondents  wer  e  chosen  for  the  study 

•  the  best  way  to  obtain  the  needed  information  is  to  come 
directly  to  the  people  who  are  most  knowledgeable  about 
the  jobs,  namely,  you  the  job  holder 

•  you  were  chosen  because,  due  to  your  job  knowledge, 
your  opinions  of  the  amount  of  involvement  of  each  skill 
in  the  performance  of  various  tasks  and  the  difference 
in  the  quality  of  performance  (as  a  function  of  each  abil¬ 
ity)  will  be  more  valid  than  the  opinions  of  people  who 
are  not  as  involved  in  the  specially 

Explain  the  respondent's  task 

•  there  are  13  abilities  that  we  are  interested  in 

•  the  abilities,  which  are  defined  in  the  definitions  list 
you  were  given,  appear  across  the  top  of  the  form 
(demonstrate) 
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•  there  are  a  total  of  60  tasks,  20  on  each  of  these  pages-- 
the  tasks  appear  vertically  down  the  left  side  of  each 
page  (demonstrate). 

•  the  tasks  appearing  in  the  form  represent  a  small  sam¬ 
ple  of  the  tasks  done  on  the  job.  They  were  obtained 
from  the  Occupational  Survey  Reports  (OSRs)  of  each 
career  field. 

•  there  are  two  sections  in  the  form.  In  the  first  section, 
you  are  asked  to  give  your  opinion  of  how  much  you  think 
each  ability  is  involved  in  the  performance  of  each  task. 

In  the  second  section,  you  are  asked  to  judge  how  the 
quality  of  performance  amoung  job  incumbents  varies  as 
a  function  of  each  ability.  Each  section  has  a  set  of  in¬ 
structions  and  examples  which  will  explain  the  purpose 
and  method  of  responding. 

•  since  this  is  a  pretest  of  the  survey  forms  and  one  pur¬ 
pose  is  to  find  out  which  one  scale,  of  two  different  types, 
will  be  better  to  use,  you  will  be  asked  to  make  the  same 
evaluations  twice  in  each  section.  One  of  the  scales, 
which  is  called  a  category  scale  (demonstrate)  has  values 
from  1  to  5.  Enter  the  value  that  best  describes  your 
opinion.  If  a  task  is  not  performed  in  your  squadron,  then 
you  would  enter  "N"  in  the  appropriate  box  (demonstrate). 
If  you  are  of  the  opinion  that  a  particular  skill  is  not  re¬ 
quired  in  the  performance  of  a  task,  then  you  enter  "NR" 
in  the  appropriate  box  (demonstrate).  The  other  scale 
you  will  use  is  called  a  magnitude  estimation  scale  (dem¬ 
onstrate).  In  using  this  scale,  you  may  select  any  value 
from  zero  to  100  that  best  describes  your  opinion.  Make 
every  effort  to  enter  a  judgment,  even  if  you  don't  perform 
the  task  yourself  and  never  did.  We  are  not  interested  in 
what  you  personally  do  on  the  job--only  in  what  you  know 
about  the  performance  of  the  tasks  on  the  list.  Your  know¬ 
ledge  of  these  tasks  could  have  come  from  your  training, 
observation,  or  past  performance.  Try  to  respond  in 
every  instance  with  a  scale  value.  There  are  scale  cards 
attached  to  every  booklet.  Remove  these  cards  and  keep 
them  in  front  of  you  as  you  make  your  judgments. 

•  to  make  your  task  easier,  fill  in  one  column  at  a  time. 
Start  with  the  first  skill,  (demonstrate)  finger  dexterity 
(FD)  and  fill  in  that  entire  column  starting  with  task  1  and 
continue  until  you  have  finished  the  last  task  in  the  column. 
Before  you  start  filling  in  the  scale  values,  read  the  defi¬ 
nition  for  the  first  skill  and  keep  the  definion  list  in  front 


of  you,  so  that  you  can  refer  to  it  whenever  necessary. 

After  you  finish  the  first  column,  read  the  definition  of 
the  second  skill  and  complete  the  second  column.  If  you 
complete  the  form  in  this  manner,  you  will  not  have  to 
remember  the  definitions  of  all  of  the  skills  at  one  time. 

•  after  you  complete  each  section  of  the  form,  go  right  on 
to  the  next.  Make  sure  that  every  box  has  a  response  in 
it.  Do  not  leave  any  blank  boxes. 

•  fill  in  the  information  called  for  on  the  cover  page.  None 
of  the  information  you  provide  will  be  reported  by  your 
name.  We  request  your  name  for  administrative  pur¬ 
poses  only.  The  data  collected  will  be  grouped  and  treat¬ 
ed  statistically.  All  information  provided  is  used  for 
research  purposes  only  and  is  held  strictly  confidential. 

•  if  you  have  any  questions,  feel  free  to  ask  at  any  time. 

7.  During  the  administration,  pass  among  the  respondents  and  make 
sure  that  the  forms  are  being  completed  in  a  downward  sequence  on 
the  page  and  that  each  respondent  is  referring  to  the  proper  definition 
for  the  column  being  completed. 

8.  Maintain  an  informal  and  friendly  atmosphere  so  that  a  rapport  be¬ 
tween  the  administrator  and  the  respondents  is  developed. 

9.  Make  extra  pencils  available  to  the  respondents,  as  needed. 

10.  Go  over  the  forms  when  they  are  turned  in  to  assure  that  there  are 
no  blanks,  glaring  errors,  or  obvious  inconsistencies.  If  any  are 
detected,  ask  the  respondent  to  review  the  form. 

Personal  Interview 


A  semistructured  personal  interview  was  conducted  with  a  sam¬ 
ple  of  the  respondents  in  order  to 

1.  provide  an  opportunity  to  acquire  retest  data  for 
a  test-retest  reliability  determination. 

2.  obtain  evaluations  of  the  appropriateness  of  the 
perceptual/  psychomotor  abilities  included  in  the 
taxonomy. 

3.  obtain  respondent  reaction  to  the  two  scaling  tech¬ 
niques. 

4.  acquire  opinions  on  methods  for  improving  the  da¬ 
ta  collection  instruments 

The  full  interview  is  presented  in  Appendix  B  to  this  report. 
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Interviewer  Instructions 


The  administrator  of  the  survey  forms  also  served  as  the  inter¬ 
viewer.  All  interviews  were  conducted  in  private  and  by  scheduled  ap¬ 
pointment,  on  the  day  following  the  completion  of  the  forms.  The  in¬ 
structions  provided  to  the  interviewer  are  presented  below. 


Interviewer  Instructions 


1.  Conduct  the  interview  in  a  quiet  place,  free  from  traffic  and  exces¬ 
sive  interference. 

2.  Introduce  yourself  and  Applied  Psychological  Services. 

3.  Explain  that  the  interview  was  designed  to  obtain  opinions  about  the 
questionnaire  forms  and  also  to  obtain  additional  information  about 
the  amount  and  performance  quality  variability  levels  of  the  various 
perceptual/ psychomotor  abilities  involved  in  the  tasks  performed 
in  the  individual's  career  field.  State  the  following: 

I  have  a  short  interview  which  will,  in  part,  be  based  on  the 
form  you  completed.  Your  answers  will  be  held  confidential. 

The  data  will  be  treated  statistically  and  your  name  will  not 
be  associated  with  it  in  any  way. 

4.  Conduct  the  interview  in  a  friendly  and  informal  manner.  This  inter¬ 
view  is  not  a  test,  but  a  fact  finding  and  opinion  searching  activity. 
Do  not  be  critical,  approving,  or  disapproving.  Listen  carefully  to 
all  comments;  be  attentive  and  supportive  at  all  times. 

5.  Complete  the  general  information  called  for  on  the  interview  form 
before  starting  the  interview. 

6.  Ask  the  questions  as  they  are  worded,  since  standardization  across 
all  respondents  is  sought.  Do  not  omit  any  portion  of  a  question,  or 
add  a  comment  that  is  not  included.  Read  the  questions  slowly  and 
clearly  and  in  the  same  order  in  which  they  appear  in  the  form. 
Present  the  interviewee  with  the  card  of  options,  wherever  indicated 
on  the  interview  form.  Repeat  a  question  that  was  misunderstood  or 
misinterpreted;  do  not  rephrase  or  reword  the  question.  If  the  re¬ 
spondent  needs  additional  time  to  think  of  a  response,  allow  it. 

7.  Provide  the  respondent  with  positive  feedback  whenever  possible  by 
nodding  your  head,  or  passing  neutral  comments  such  as  "yes,  " 
"okay,  "  or  "I  see.  " 

8.  If  a  response  is  incomplete  or  irrelevant,  probe  for  a  more  accept¬ 
able  response.  This  may  be  accomplished  by  repeating  the  question 
or  the  response.  Other  effective  probes  are  to  ask  if  there  is  "any¬ 
thing  else,"  "how  so,"  or  "can  you  explain  that  to  me." 


9.  Record  responses  in  the  spaces  provided  on  the  interview  form  at 
the  time  the  responses  are  provided. 

10.  It  is  important  that  the  interviewee  understands  the  polarity  of  the 
rating  scales.  For  example,  zero  means  very  unimportant  or  very 
easy. 

11.  Answer  all  questions  in  a  neutral  manner.  Terminate  the  interview 
by  thanking  the  individual  for  cooperating. 


Interview  Sample 


Twenty-four  interviews  were  condueted--12  representing  job  in¬ 
cumbents  in  each  of  the  two  career  fields.  In  each  career  field,  six  su¬ 
pervisors  and  six  subordinates  were  interviewed.  Every  supervisor,  in 
both  career  fields,  had  served  in  that  career  field  and  in  the  Air  Force 
for  over  five  years.  The  subordinates  who  were  interviewed  were  some¬ 
what  less  experienced  than  their  supervisor  counterparts.  As  a  group, 
they  were  equally  divided  in  their  career  field  experience.  Approximate¬ 
ly  one -half  had  served  three  to  five  years  and  the  other  half  had  served 
more  than  five  years  in  their  career  field. 


Results  -  -Quantitative 


A  set  of  data  analyses  was  completed  in  order  to  determine  the 
utility  of  the  methods  and  taxonomy.  These  analyses  sought 

1.  To  establish  the  ability  of  the  13  taxonomic  classes 
to  differentiate  among  tasks. 

2.  To  examine  the  relationship  between  the  supervisory 
and  the  subordinate  perceptions  of  job  perceptual/ psy¬ 
chomotor  skill  influences. 

3.  To  examine  the  relationship  between  the  amount  of 
the  abilities  required  in  the  performance  of  the  tasks 
and  the  performance  quality  variability. 

4.  To  develop  profiles  of  perceptual/ psychomotor  abil¬ 
ities  for  each  specialty. 

5.  To  determine  the  relationship  between  the  categori¬ 
cal  and  the  magnitude  estimation  judgments  and  the 
nature  of  the  underlying  scale  of  each. 

6.  To  evaluate  interrater  agreements. 

7.  To  obtain  measures  of  test-retest  reliability. 


(il 


Discrimination- -Taxonomic  Classes -- 
Fire  Protection  Career  Field 

To  obtain  information  about  the  ability  of  the  taxonomic  classes 
to  discriminate,  measures  of  central  tendency  were  calculated  for  the 
13  perceptual/  psychomotor  abilities.  For  the  Fire  Protection  (571XX) 
career  field,  these  were  calculated  separately  for  the  supervisory  rat¬ 
ers  and  subordinate  raters,  for  both  scaling  techniques,  as  well  as  for 
the  amount  and  performance  quality  variability  judgments.  The  results 
are  presented  in  Table  3-3. 

The  mean  data  for  the  categorical  scale  evaluations  of  the  Fire 
Protection  career  field  indicated,  at  best,  only  a  moderate  range  across 
the  13  taxonomic  classes.  The  range  of  the  mean  value  for  the  supervi¬ 
sors  was  1.9  to  3.  4,  while  the  range  for  the  subordinates  was  2.4  to  3.3. 
The  midpoint  of  these  values  was  approximately  2.9,  in  both  cases. 
These  ranges  seem  somewhat  restricted.  The  standard  deviations  a- 
round  the  means  showed  reasonable  spread  for  each  taxonomic  class. 
The  standard  deviations  ranged  from  1.2  to  1.6  and  1.4  to  1.7,  for  the 
supervisors  and  subordinates,  respectively. 

For  the  magnitude  estimation  method  in  the  Fire  Protection  ca¬ 
reer  field  (Table  3-3),  the  range  of  mean  values  for  the  13  abilities  was 
28  to  53  for  the  amount  judgments  of  the  supervisors  (with  a  spread  of 
standard  deviations  ranging  from  25  to  38)  and  from  38  to  55  (with  stand¬ 
ard  deviations  ranging  from  26  to  32)  for  the  judgments  by  subordinates. 
Again,  these  ranges  seem  somewhat  restricted.  As  with  the  categorical 
scale,  the  approximate  midpoint  of  the  evaluations  was  at  the  low  end 
of  the  ''moderate"  portion  of  the  magnitude  estimation  scale (43  for  the 
supervisor  group  and  46  for  the  subordinates). 

The  data  for  the  performance  quality  variability  indicated  a  less¬ 
er  spread  of  mean  data  and  standard  deviations,  as  well  as  a  consistent¬ 
ly  lower  set  of  scale  value  selections  than  the  amount  data.  Table  3 -3  in¬ 
dicates  a  range  of  mean  data  on  the  categorical  scale  judgments,  across 
the  13  abilities,  of  1.7  to  2.5  (with  standard  deviations  ranging  from  1.  2 
to  1.4)  and  2.2  to  2.6  (with  standard  deviations  ranging  from  1.3  to  1.5) 
for  the  supervisors  and  subordinates,  respectively.  Similarly,  the  per¬ 
formance  quality  variability  magnitude  estimation  scale  judgments  indi¬ 
cated  less  spread  than  the  amount  judgments  and  lower  scale  choices, 
e.g. ,  a  range  of  26  to  45  for  the  supervisors  (with  a  standard  deviation 
range  from  26  to  31)  and  35  to  45  for  the  subordinates  (with  a  standard 
deviation  range  from  27  to  41). 

While  the  mean  scale  values  for  amount  and  for  performance 
quality  variability  were  distributed  in  close  proximity,  making  i1 


Table  3-3 


Perceptual/  Psychomotor  Ability  Means  and 
Standard  Deviations  for  the  Fire  Protection  Career  Field 
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Categorical  Scale 


Amount 

Supervisor  Subordinate 


M 


Performance  Quality  Variability 
Supervisor  Subordinate 


M 


FD 

2.7 

1.4 

2.8 

1.4 

2.2 

1.3 

2.2 

1.3 

MD 

3.1 

1.5 

3.2 

1.4 

2.5 

1.4 

2.5 

1.4 

CP 

3.1 

1.5 

2.9 

1.5 

2.4 

1.4 

2.4 

1.3 

RC 

3.1 

1.6 

2.7 

1.6 

2.4 

1.4 

2.3 

1.4 

VM 

3.4 

1.4 

3.1 

1.4 

2.3 

1.3 

2.6 

1.4 

VSA 

2.9 

1.5 

3.0 

1.5 

2.4 

1.3 

2.3 

1.3 

PM 

3.1 

1.5 

3.3 

1.5 

2.3 

1.3 

2.6 

1.4 

AD 

2.5 

1.5 

2.9 

1.5 

2.2 

1.4 

2.4 

1.4 

AM 

2.5 

1.5 

2.7 

1.5 

2.2 

1.4 

2.6 

1.3 

CLP 

1.9 

1.2 

2.4 

1.5 

1.7 

1.2 

2.5 

1.5 

DP 

2.7 

1.6 

2.9 

1.7 

2.2 

1.4 

2.5 

1.4 

DA 

2.6 

1.5 

2.7 

1.5 

2.1 

1.3 

2.4 

1.3 

KM 

2.3 

1.4 

2.4 

1.5 

2.0 

1.3 

2.5 

1.4 

erceptual/ 

sychomotor 

jility 

Magnitude  Estimation  Scale 

Amount  Performance  Quality  Variability 

Supervisor  Subordinate  Supervisor  Subordinate 

p.  a.  <: 

M 

a 

M 

0 

M 

0 

M 

a 

FD 

42.8 

30.1 

46.5 

27.1 

37.7 

29.8 

35.4 

28.0 

MD 

50.8 

31.3 

55.1 

26.1 

41.5 

29.5 

39.0 

29.4 

CP 

47.6 

31.3 

50.5 

29.0 

41.1 

29.0 

40.4 

29.2 

RC 

45.0 

33.3 

45.7 

30.9 

42.3 

30.5 

43.6 

29.1 

VM 

49.8 

30.1 

49.4 

29.9 

44.8 

30.7 

41.0 

29.4 

VSA 

49.8 

36.9 

48.6 

31.9 

39.6 

30.1 

40.7 

29.7 

PM 

52.8 

35.7 

52.3 

31.3 

45.1 

30.4 

43.8 

29.2 

AD 

41.7 

38.1 

46.8 

30.6 

35.3 

29.2 

42.3 

28.9 

AM 

42.3 

31.1 

44. 1 

29.5 

33.9 

29.9 

42. 1 

40.9 

CLP 

28.2 

25.0 

38.1 

28.2 

26.3 

27.3 

42.3 

31.3 

DP 

40.6 

32.2 

47.1 

29.9 

33.5 

28.8 

41.8 

29.7 

DA 

37.2 

28.7 

44.2 

28.3 

33.9 

25.6 

37.7 

27.2 

KM 

37.9 

29.5 

44.7 

30.5 

30.6 

26.9 

44.5 

29.5 
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difficult  to  separate  the  perceptual/ psychomotor  abilities  into  high  and 
low  groups,  an  arrangement  into  high  and  low  groups  of  abilities  was 
possible  in  each  case.  The  mean  scale  values  for  the  abilities  were 
hierarchically  arranged  (from  high  to  low)  and  lines  of  demarcation 
were  drawn  between  the  largest  gaps,  separating  the  abilities  into  high 
and  low  groups  (on  each  scale).  The  results  are  as  follows: 


High: 

Supervisors 


Subordinates 


Low: 

Supervisors 

Subordinates 


High: 

Supervisors 


Subordinates 


Amount 

Categorical  Scale 

Manual  Dexterity 
Control  Precision 
Rate  Control 
Visual  Memory 
Position  Memory 

Manual  Dexterity 
Visual  Memory 
Visual  Speed  and 
Accuracy 
Position  Memory 


Clerical  Perception 
Kinesthetic  Memory 

Clerical  Perception 
Kinesthetic  Memory 


Manual  Dexterity 
Control  Precision 
Rate  Control 
Visual  Speed  and 
Accuracy 

Visual  Memory 
Position  Memory 
Auditory  Memory 


Magnitude 
Estimation  Scale 


Manual  Dexterity 
Visual  Memory 
Visual  Speed  and 
Accuracy 
position  Memory 

Manual  Dexterity 
Control  Precision 
Position  Memory 


Clerical  Perception 

Clerical  Perception 


Magnitude 
Estimation  Scale 


Visual  Memory 
Position  Memory 


Rate  Control 
Position  Memory 
Kinesthetic  Memory 


Performance  Quality  Variability 


Categorical  Scale 


Low: 


Supervisors  Clerical  Perception  Clerical  Perception 

Subordinates  Finger  Dexterity  Finger  Dexterity 

This  suggests  that,  in  spite  of  the  somewhat  restricted  i-ange 
yielded  by  the  taxonomy  and  scales,  some  separation  can  be  achieved. 
Moreover,  the  "high"  and  the  "low”  results  seem  to  make  sense  in 
terms  of  what  is  generally  known  about  the  duties  of  the  Fire  Protection 
career  field. 


Discrimination --Taxonomic  Classes-- 
Munitions  Maintenance  Career  Field 


fable  3-4  presents  the  13  taxonomic  class  means  and  standard 
deviations  for  both  the  categorical  and  magnitude  estimation  scale  judg¬ 
ments  for  the  Munitions  Maintenance  career  field.  The  range  for  the  su¬ 
pervisors  on  the  categorical  scale,  for  the  amount  judgments,  was  from 
1.4  to  2.9  (with  a  range  of  standard  deviations  from  0.9  to  1.5)  and  the 
range  for  the  subordinates  was  from  1.  3  to  2.  9  (with  a  range  of  standard 
deviations  from  0.  8  to  1.6).  On  the  magnitude  estimation  scale,  the  range 
of  means  for  the  supervisors  was  from  15  to  40  and  it  was  from  24  to  48 
for  the  subordinates.  The  standard  deviations,  for  the  respective  groups 
ranged  from  15  to  30  and  from  22  to  57.  Again,  the  somewhat  restricted 
range  of  the  responses  is  evident. 

For  quality  variability  and  the  categorical  scale,  the  range  of 
mean  judgments  was  from  1.  6  to  2.  1  for  the  supervisors  and  from  1.7  to 
2.  1  for  the  subordinates.  The  standard  deviations  were  again  reasona¬ 
ble  and  ranged  from  0.  9  to  1.2  for  the  supervisors  and  from  1.2  to  1.5 
for  the  subordinates.  The  magnitude  estimation  scale  produced  the  fol¬ 
lowing  range  of  mean  data  for  quality  variability:  22  to  30  for  the  super¬ 
visors  and  18  to  31  for  the  subordinates.  The  range  of  standard  devia¬ 
tions  for  the  supervisors  was  from  19  to  25  for  the  supervisors  and  it  was 
from  19  to  28  for  the  subordinates. 

The  distribution  of  mean  judgments  over  the  13  abilities  was 
again  such  that  lines  of  demarcation  could  be  readily  interposed  on  a  dis¬ 
tribution  of  the  values,  forming  meaningful  relative  groups  of  "high"  and 
"low"  abilities.  Such  a  result,  at  least  partially,  supports  the  discrimi¬ 
nating  power  of  the  methods  employed. 


Table  3-4 


Ability  Means  and  Standard  Deviations  for  the 
Munitions  Maintenance  Career  Field 
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Categorical  Scale 

Amount  Performance  Quality  Variability 

Supervisor  Subordinate  Supervisor  Subordinate 

M  a  M  a  McrMa 


FD 

2.0 

1.1 

2.3 

1.4 

1.8 

1.2 

1.9 

1.3 

MD 

2.3 

1.4 

2.5 

1.5 

1.8 

1.1 

1.9 

1.3 

CP 

2.1 

1.4 

2.0 

1.4 

1.8 

1.2 

1.8 

1.2 

RC 

1.8 

1.3 

2.0 

1.5 

1.7 

1.1 

1.7 

1.2 

VM 

2.9 

1.5 

2.9 

1.5 

2.1 

1.2 

2.1 

1.3 

VSA 

2.6 

1.5 

2.7 

1.6 

2.1 

1.2 

2.0 

1.3 

PM 

2.6 

1.5 

2.7 

1.5 

1.9 

1.2 

2.1 

1.4 

AD 

2.0 

1.4 

2.2 

1.5 

1.7 

1.2 

1.9 

1.4 

AM 

1.8 

1.2 

1.9 

1.4 

1.6 

1.2 

1.9 

1.5 

CLP 

2.3 

1.5 

2.6 

1.5 

1.8 

1.1 

2.0 

1.4 

DP 

1.9 

1.3 

2.2 

1.5 

1.7 

1.1 

1.9 

1.4 

DA 

1.8 

1.2 

2.2 

1.4 

1.6 

0.9 

1.8 

1.2 

KM 

1.4 

0.9 

1.3 

0.8 

1.6 

1.1 

1.8 

1.4 
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Magnitude  Estimation  Scale 

Amount  Performance  Quality  Variability 

Supervisor  Subordinate  Supervisor  Subordinate 

MoMcr  MaMo 


FD 

25.4 

20.8 

30.7 

23.7 

22.3 

20.8 

26.5 

23.5 

MD 

33.8 

27.7 

38.2 

28.1 

24.1 

21.0 

30.5 

27.4 

CP 

31.2 

27.6 

29.9 

27.4 

25.0 

22.3 

26.9 

24.8 

RC 

23.9 

25.3 

29.3 

28.0 

23.3 

22.7 

26.2 

24.2 

VM 

39.7 

28.4 

45.6 

30.0 

29.6 

23.0 

30.9 

25.4 

VSA 

37.5 

29.7 

46.1 

56.7 

28.5 

22.6 

30.4 

27.0 

PM 

38.3 

29.1 

47.6 

29.6 

26.9 

23.0 

30.9 

26.3 

AD 

26.9 

27. 1 

33.9 

30.0 

24.9 

22.4 

26.2 

23.5 

AM 

i1).  ' 

26.2 

30.4 

28.8 

23.1 

22.0 

30.4 

27.6 

2  7.  } 

40.3 

30.5 

24.3 

21.5 

27.0 

23.2 

.  •  - 

2  3.  i 

)9. 4 

30.7 

22.6 

21.1 

24.7 

24.1 

)  7.  J 

29.5 

24.0 

24.6 

23.5 

21.5 

21,5 

7).  5 

19.2 

18.2 

19.4 

High: 

Supe rvisors 


Subordinates 


Low: 

Supervisors 

Subordinates 


Amount 

Categorical  Scale 


Visual  Memory 
Visual  Speed  and 
Accuracy 
Position  Memory 

Manual  Dexterity 
Visual  Memory 
Visual  Speed  and 
Accuracy 
Position  Memory 
Clerical  Perception 


Kinesthetic  Memory 
Kinesthetic  Memory 


Magnitude 
Estimation  Scale 


Visual  Memory 
Visual  Speed  and 
Accuracy 
Position  Memory 

Visual  Memory 
Visual  Speed  and 
Accuracy 
Position  Memory 


Kinesthetic  Memory 
Kinesthetic  Memory 


Performance  Quality  Variability 


Categorical  Scale 

Magnitude 
Estimation  Scale 

High; 

Supervisors 

Visual  Memory 

Visual  Speed  and 
Accuracy 

Visual  Memory 
Visual  Speed  and 
Accuracy 

Subordinates 

Visual  Memory 

Visual  Speed  and 
Accuracy 

Position  Memory 
Clerical  Perception 

Manual  Dexterity 
Visual  Memory 
Position  Memory 

Low: 

Supe rvisors 

Auditory  Memory 
Divided  Attention 
Kinesthetic  Memory 

Finger  Dexterity 
Kinesthetic  Memory 

Subordinates 

Rate  Control 

Kinesthetic  Memory 
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Discrimination --Tasks  -  -  Fire  Protection 


In  a  similar  vein,  the  means  and  standard  deviations  for  the  20 
tasks  (for  amount  and  performance  quality  variability)  on  each  scale 
were  calculated  for  the  Fire  Protection  specialty.  These  appear  in 
Table  3-5,  The  two  sets  of  mean  data,  supervisor  and  subordinate  re¬ 
spectively,  for  amount  on  the  categorical  scale  ranged  from  1.7  to  3.  8 
and  from  2.0  to  3.9.  This  result  seems  more  acceptable  than  that  in¬ 
dicated  for  the  taxonomic  classes.  The  standard  deviations  for  these 
mean  datawas  entirely  acceptable--l.l  to  1.6  for  the  supervisor  group 
and  from  1.  3  to  1.  6  for  the  subordinate  group.  The  magnitude  estima¬ 
tion  scale  data  indicated  similar  results  for  the  amount  date  (Table  3-5). 
The  range  of  mean  data  for  the  tasks,  for  amount,  ranged  from  24  to  63 
for  the  supervisors  (with  a  standard  deviation  range  of  21  to  52);  the  range 
for  the  subordinates  was  from  30  to  69  (with  a  standard  deviation  range 
of  24  to  31). 

For  the  performance  quality  variability  data  (Table  3-5),  the  su¬ 
pervisors'  range  of  mean  amount  judgments  on  the  categorical  scale  was 
1.4  to  3.  1;  the  range  for  the  subordinates  was  1.  8  to  3.  7.  These  ranges 
are  again  broader  than  for  the  parallel  analysis  in  which  taxonomic 
classes  were  considered  across  tasks.  The  respective  ranges  of  stand¬ 
ard  deviations  were  0.  8  to  1.5  and  1.2  to  1.4.  On  the  magnitude  estima¬ 
tion  scale,  the  range  of  performance  quality  variability  means  for  super¬ 
visors  across  the  20  tasks,  was  23  to  57  (with  a  standard  deviation  range 
from  21  to  31).  The  range  for  subordinates,  on  the  same  scale,  was  32 
to  65  (with  a  standard  deviation  range  from  25  to  48). 

Accordingly,  the  restricted  range  patterns  seen  for  the  individual 
taxonomic  classes  was  somewhat  broken  for  the  task  data. 


Discrimination  -  -Tasks  -  -  Munitions  Mainte  nance 


Table  3-6  presents  the  means  and  standard  deviations  for  the 
amount  and  performance  quality  variability  judgments,  on  both  scales, 
for  each  group  of  Munitions  Maintenance  judges.  The  range  of  the  amount 
judgments,  for  supervisors  and  subordinates,  on  the  categorical  scale, 
was  1.7  to  3.1  and  1.8  to  3.2,  respectively.  These  ranges  seem  quite 
acceptable  and  are  greater  than  the  corresponding  ranges  for  the  taxonom¬ 
ic  class  data.  The  range  of  standard  deviations  for  the  supervisors  was 
1.0  to  1.7  and  1.  1  to  1.7  for  the  subordinates.  The  range  on  the  magni¬ 
tude  estimation  scale  for  supervisors  was  19  to  53  (with  a  standard  devia¬ 
tion  range  from  16  to  33);  the  range  for  subordinates  was  25  to  54  (with  a 
range  of  standard  deviations  from  22  to  71).  These  values,  too,  are  con¬ 
siderably  greater  than  for  the  taxonomic  class  data.  The  mean  categorical 
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Table  3-5 


Task  Means  and  Standard  Deviations  Across 
Abilities  for  the  Fire  Protection  Career  Field 


Categorical  Scale 


Amount  Performance  Quality  Variability 

Supervisor  Subordinate  Supervisor  Subordinate 


Task 

M 

o 

M 

a 

M 

a 

M 

a 

1 

3.8 

1.4 

3.9 

1.4 

3.1 

1.5 

3.7 

1.4 

2 

2.5 

1.4 

2.6 

1.5 

2.0 

1.1 

2.5 

1.4 

3 

1.7 

1.1 

2.0 

1.3 

1.4 

0.8 

2.0 

1.3 

4 

3.4 

1.4 

3.3 

1.5 

2.3 

1.2 

2.5 

1.4 

5 

2.7 

1.5 

2.7 

1.5 

2.2 

1.2 

2.4 

1.4 

6 

2.6 

1.4 

2.6 

1.4 

2.0 

1.2 

2.1 

1.2 

7 

3.4 

1.5 

3.2 

1.5 

2.6 

1.4 

2.8 

1.4 

8 

3.3 

1.6 

2.9 

1.5 

2.7 

1.5 

2.4 

1.4 

9 

3.1 

1.5 

3.0 

1.5 

2.7 

1.5 

2.6 

1.4 

10 

3.3 

1.5 

3.0 

1.4 

2.4 

1.4 

2.5 

1.2 

11 

3.1 

1.5 

3.1 

1.4 

2.4 

1.4 

2.6 

1.3 

12 

3.4 

1.4 

3.0 

1.4 

2.5 

1.4 

2.4 

1.3 

13 

2.3 

1.4 

2.4 

1.5 

1.8 

1.2 

2.0 

1.3 

14 

2.8 

1.5 

3.0 

1.6 

2.5 

1.3 

2.5 

1.3 

15 

2.2 

1.3 

2.5 

1.4 

1.7 

1.0 

2.0 

1.2 

16 

2.0 

1.2 

2.3 

1.4 

1.4 

0.8 

2.1 

1.3 

17 

3.4 

1.5 

3.3 

1.4 

2.6 

1.4 

2.8 

1.4 

18 

2.7 

1.5 

3.0 

1.5 

2.2 

1.4 

2.4 

1.3 

19 

1.9 

1.3 

2.5 

1.5 

1.8 

1.1 

1.8 

1.2 

20 

2.4 

1.5 

3.0 

1.6 

2.0 

1.5 

2.4 

1.4 

Magnitude  Estimation  Scale 


Amount 

Supervisor  Subordinate 


Tas  It 

M 

a 

M 

0 

1 

63.1 

30.6 

68.9 

29.0 

2 

34.5 

27.7 

43.9 

30.1 

3 

25.2 

21.8 

30.1 

23.5 

4 

46.2 

30.1 

48.8 

31.4 

5 

42.5 

29.8 

42.9 

29.2 

6 

39.8 

28.7 

44.2 

27.3 

7 

52.9 

31.4 

50.8 

28.8 

8 

49.3 

31.6 

47.2 

29.8 

9 

48.3 

30.3 

50.5 

29.4 

10 

51.4 

31.0 

51.7 

29.7 

11 

51.3 

31.0 

53.7 

29.3 

12 

52.0 

51.7 

50.0 

28.6 

13 

35.3 

30.0 

38.6 

30.1 

14 

48.5 

31.0 

50.7 

29.9 

15 

30.6 

25.1 

39.5 

28.3 

16 

23.7 

21.4 

34.0 

25.1 

17 

54.7 

31.9 

55.3 

29.2 

18 

44.9 

30.7 

49.7 

29.1 

19 

34.6 

29.2 

44.2 

2b. 5 

20 

44.6 

32.8 

47.8 

29.3 

Performance  Quality  Variability 
Supervisor  Subordinate 


M 

0 

M 

a 

56.8 

31.1 

64.6 

30.4 

32.2 

28.1 

39.7 

29.4 

22.8 

20.8 

37.7 

30.4 

43.0 

30.5 

42.0 

29.9 

39.8 

29.2 

38.3 

28.1 

32.8 

28.0 

31.9 

25.0 

46.8 

30.7 

48.5 

28.6 

43.7 

29.  7 

40.1 

28.5 

42.7 

29.2 

44.1 

26.9 

39.7 

28.8 

39.3 

25.9 

39.  7 

29.3 

42.6 

26.2 

39.4 

29.9 

39.7 

28.0 

31.2 

27.7 

38.5 

47.8 

44.1 

29.8 

39.0 

25.7 

28.6 

25.1 

33.2 

26.7 

25.8 

24.0 

36.1 

28.8 

45.3 

30.1 

46.0 

28.5 

36.8 

29.7 

36.3 

27.7 

30.6 

26.4 

32.4 

25.6 

33.3 

29.5 

40.6 

30.5 
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Table  3-t> 


Task  Means  and  Standard  Deviations  for 
Munitions  Maintenance  Career  Field 


Categorical  Scale 

Amount  Performance  Quality  Variability 

Supervisor  Subordinate  Supervisor  Subordinate 


Task. 

M 

<J 

M 

CJ 

M 

a 

M 

or 

1 

2.4 

1.5 

2.5 

1.5 

2.0 

1.3 

2.0 

1.3 

2 

2.0 

1.3 

2.4 

1.5 

1.6 

1.0 

2.1 

1.5 

3 

2.3 

1.5 

2.3 

1.5 

1.8 

1.1 

2.1 

1.4 

4 

1.7 

1.1 

1.8 

1.2 

1.5 

0.9 

1.6 

1.2 

5 

1.8 

1.2 

2.0 

1.4 

1.7 

1.1 

1.5 

0.9 

6 

1.7 

1.2 

1.8 

1.3 

1.4 

0.8 

1.3 

0.8 

7 

2.2 

1.4 

2.3 

1.4 

1.7 

1.0 

1.8 

1.2 

8 

1.8 

1.0 

2.0 

1.3 

1.4 

0.8 

1.5 

1.1 

9 

2.2 

1.4 

2.3 

1.4 

1.7 

1.0 

2.0 

1.3 

10 

2.8 

1.5 

3.0 

1.6 

2.4 

1.3 

2.5 

1.5 

11 

3.1 

1.6 

3.2 

1.6 

2.6 

1.4 

2.7 

1.5 

12 

1.7 

1.0 

1.8 

1.1 

1.4 

0.8 

1.5 

1.0 

13 

2.4 

1.4 

2.6 

1.4 

2.1 

1.3 

2.1 

1.4 

14 

2.2 

1.4 

2.4 

1.5 

1.9 

1.2 

1.9 

1.3 

15 

2.1 

1.3 

2.0 

1.3 

1.7 

1.0 

1.7 

1.2 

16 

2.6 

1.7 

2.7 

1.7 

2.1 

1.4 

2.2 

1.5 

17 

1.9 

1.3 

2.3 

1.5 

1.7 

1.1 

1.9 

1.4 

18 

1.9 

1.3 

1.9 

1.4 

1.6 

1.0 

1.6 

1.1 

19 

2.2 

1.3 

2.2 

1.3 

1.7 

l.J 

1.8 

1.2 

20 

2.1 

1.3 

2.5 

1.5 

1.6 

1.) 

2.1 

1.5 

Magnitude  Estimation  Scale 


Amount  Performance  Quality  Variability 

Supervisor  Subordinate  Supervisor  Subordinate 


Task 

M 

o 

M 

0 

M 

0 

M 

a 

1 

34. a 

29.7 

j9.3 

29.7 

26.0 

22.6 

26.6 

23.5 

2 

27.4 

26.  S 

40.2 

71.4 

22.5 

19.7 

25.2 

23.0 

3 

31.4 

26.9 

35.5 

29.5 

23.1 

20.9 

26.6 

23.5 

4 

20.3 

18.7 

24.5 

22.3 

19.5 

17.9 

18.9 

18.6 

5 

23.8 

23.3 

30.6 

27.6 

21.4 

19.2 

23.3 

22.3 

6 

22.0 

22.0 

28.6 

26.0 

18.1 

1.  .9 

22.5 

20.9 

7 

30.1 

25.3 

33.7 

25.8 

23.1 

18  2 

27.0 

23.2 

8 

19.8 

17.7 

26.0 

22.7 

17.4 

15.9 

20.0 

19.1 

9 

31.6 

26.3 

36.6 

28.4 

24.0 

19.  7 

24.9 

23.1 

10 

46.8 

30.8 

52.1 

31.5 

39.5 

27.3 

39.5 

29.1 

11 

52.5 

31.9 

54.4 

31.5 

43.0 

28.0 

42.8 

29.5 

17. 

18.8 

15.5 

26.3 

22.2 

18.0 

16.1 

19.4 

18.5 

13 

35.6 

27.2 

41.7 

27.6 

29.8 

23.3 

32.4 

26.1 

14 

30.2 

25.8 

40.8 

30.7 

27.3 

24.0 

25.9 

23.6 

15 

30.8 

27.2 

33.4 

26.5 

22.1 

19.  1 

23.1 

20.7 

16 

40.3 

33.4 

43.2 

32.6 

29.3 

26.7 

32.7 

29.0 

17 

26.1 

25.4 

36.1 

29.3 

23.8 

22,  5 

28.1 

25.6 

18 

25.1 

26.5 

31.7 

29.0 

20.5 

18.  t 

20.6 

19.6 

19 

28.6 

24.4 

37.5 

27.9 

21.6 

18.3 

26.7 

24.0 

20 

25.7 

23.4 

41.4 

30.4 

18.7 

17.8 

35.4 

29.6 

ii 
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scale  performance  quality  variability  data  for  the  supervisors  achieved 
a  range  from  1 .4  to  2.6  (with  a  standard  deviation  range  from  0.8  to  1.4). 
The  range  for  the  subordinates  was  1.3  to  2.7  (with  a  standard  deviation 
range  of  0.8  to  1.5).  The  magnitude  estimation  scale  produced  super¬ 
visor  mean  range  of  17  to  43  (with  a  standard  deviation  range  of  16  to  28) 
and  a  subordinate  mean  range  of  19  to  43  (with  a  standard  deviation 
range  of  19  to  30). 

Discussion  and  Summary  of  Discrimination  Analyses 

The  prior  sets  of  analyses  suggest  that  the  techniques  do  little 
to  discriminate  among  taxonomic  classes  when  abilities  are  judged 
across  tasks.  On  the  other  hand,  the  techniques  seem  more  sensitive 
when  tasks  were  judged  across  individual  taxonomic  classes.  Table  3-7 
summarizes  the  range  of  mean  values  yeilded  by  the  separate  methods 
and  rater  levels  by  career  fields.  In  all  corresponding  cells,  the  range 
for  task  ratings  across  taxonomic  classes  is  greater  than  the  range 
for  taxonomic  classes  across  tasks.  The  ranges  for  the  task  ratings 
across  classes  seem  to  suggest  acceptable  sensitivity  but  the  same  can 
not  be  said  for  the  taxonomic  class  across  task  data.  This  suggests  that 
data  of  the  nature  here  involved  are  best  sought  at  the  task  level. 

Regardless  of  scaling  approach  or  set  of  judges,  the  data  suggest 
that  the  two  career  fields  involved  in  the  pretest  are  not  heavily  loaded 
in  perceptual/ psychomotor  requirements  of  the  type  included  in  our  tax¬ 
onomy.  All  distributions  were  skewed  to  the  left.  While  the  possibility 
of  rater  error  exists,  such  an  explanation  does  not  seem  tenable  in  view 
of  the  controls  instituted,  the  diversity  of  the  two  career  fields  involved, 
and  the  experience  range  of  the  two  subject  groups. 

Amount  and  Performance  Quality  Variability  Comparisons 

A  visual  inspection  of  the  mean  data  presented  in  Tables  3-3  and 
3-4  suggests  a  degree  of  association  between  the  two  judged  variables -- 
amount  and  performance  quality  variability.  In  order  to  examine  further 
the  association  between  these  variables,  product  moment  correlation  co¬ 
efficients  were  calculated.  The  resultant  correlation  coefficients  are 
presented  in  Table  3-8. 

The  correlation  between  the  judgments  of  amount  and  perform¬ 
ance  quality  variability  was  moderate  to  high  in  six  of  the  eight  compar¬ 
isons.  A  comparison  of  the  supervisor  and  the  subordinate  correlation 
coefficients  in  Table  3-8  indicates,  in  all  cases,  slightly  depressed  co¬ 
efficients  for  the  subordinates.  This  suggests  that  the  supervisors  tend¬ 
ed  to  judge  a  task  as  having  greater  performance  quality  variability  for 


ielded  by  Separate  Methods  and  Rater  Levels 


Table  3-8 


Product  Moment  Correlation  Between  Amount 
and  Performance  Quality  Variability  (N  =  13  Abilities) 


Fire  Protection  (571XX) 

Variable  _r 

Supervisor,  categorical  scale  .87 

Subordinate,  categorical  scale  .23 

Supervisor,  magnitude  scale  .93 

Subordinate,  magnitude  scale  -.15 

Meanr  =  . 65 

Munitions  Maintenance  (461XX) 

Supervisor,  categorical  scale  .90 

Subordinate,  categorical  scale  .76 

Supervisor,  magnitude  scale  .84 

Subordinate,  magnitude  scale  .65 

Meanr  “  -81 

Grand  Meanr  “  .74 
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a  particular  ability  when  the  task  required  a  greater  amount  of  the  abil¬ 
ity  for  successful  performance.  Conversely,  those  tasks  that  varied 
less  in  the  performance  quality  variability,  as  a  function  of  a  specific 
ability,  were  regarded  by  the  supervisors  as  requiring  less  of  the  abili¬ 
ty  for  successful  performance.  Subordinates,  on  the  other  hand,  seemed 
to  make  slightly  more  independent  judgments  on  the  amount  and  perform¬ 
ance  quality  variability  factors. 

Moderately  high  correlations  were  obtained  when  the  average 
correlation  (obtained  by  averaging  the  z -coefficient  equivalents)  was  ob¬ 
tained  for  each  specialty--.  65  and  .  81  for  Fire  Protection  and  Munitions 
Maintenance  career  fields,  respectively.  The  estimate  of  the  population 
value  was.  74  when  the  eight  separate  correlation  coefficients  were  aver¬ 
aged. 


The  correlational  data,  taken  as  a  group,  suggest  that  the  two 
questions  are  moderately  interdependent.  There  is  an  indication  that 
some  association  exists  between  the  perceptions  of  the  amount  of  an 
ability  required  to  perform  a  task  and  the  performance  quality  variabil¬ 
ity  it  produces.  However,  from  the  point-of-view  of  job  analytic  thor¬ 
oughness,  it  seems  that  both  questions  may  best  be  considered  in  any 
job  analysis  which  aims  to  be  complete. 

Supervisor  and  Subord inate  Comparis on s 


If  the  judgments  of  supervisors  and  subordinates  can  be  demon¬ 
strated  to  be  associated,  then  a  position  could  be  taken  that  supervisor- 
subordinate  judgments  may  be  combined  prior  to  the  analytic  treatment 
of  the  data,  and  in  future  work,  distinctions  between  the  two  groups 
may  be  disregarded.  In  this  regard,  note  the  similarity  between  the 
mean  data  of  the  supervisors  and  the  subordinates  for  tasks  and  for 
performance  quality  variability  reported  in  Tables  3-3,  3-4,  3-5,  and 
3-6. 


Table  3-9  presents  the  correlation  between  supervisor  and  sub¬ 
ordinate  judgments  for  amount  and  performance  quality  variability  sep¬ 
arately,  by  rating  scale  type.  The  correlation  coefficients  of  Table  3-9 
show  a  close  association  between  the  supervisor  and  subordinate  rat¬ 
ings  of  amount,  regardless  of  type  of  rating  scale. 

The  average  correlation  between  supervisory  and  subordinate 
judgments  in  the  Fire  Protection  specialty,  across  rating  scales, 
amount,  and  performance  quality  variability  was  .54.  An  average  of 
.84  was  obtained  for  the  Munitions  Maintenance  specialty.  An  esti¬ 
mate  of  the  population  value  was  obtained  by  averaging  the  correlations 
across  both  specialties.  The  obtained  correlation,  .72,  was  consider¬ 
ed  moderately  high. 


Table  3-9 


Product  Moment  Correlations  Between 
Supervisors  and  Subordinates  (N  -13  Abilities) 

Fire  Protection  (571XX) 

Variable  _r 

Amount,  categorical  scale  .79 

Performance  quality  variability,  categorical  scale  -.10 

Amount,  magnitude  scale  .91 

Performance  quality  variability,  magnitude  scale  -.09 

Meanr  =  . 54 

Munitions  Maintenance  (461XX) 

Amount,  categorical  scale  .94 

Performance  quality  variability,  categorical  scale  .63 

Amount,  magnitude  scale  .91 

Performance  quality  variability,  magnitude  scale  .67 

Meanr  =  . 84 

Grand  Meanr  =  .72 
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Accordingly,  some  basis  exists  for  combining  the  data  produced 
by  the  two  sets  of  respondents  or  for  using  only  one  or  the  other  group 
of  respondents  in  job  analytic  studies  of  the  type  considered  here. 

Test-Retest  Reliability 

In  order  to  collect  data  relative  to  the  response  stability  within 
judges,  the  24  raters  who  participated  in  the  personal  interview  reeval¬ 
uated  a  sample  of  10  tasks  on  each  of  the  13  perceptual/  psychomotor 
taxonomic  classes.  The  group  was  divided  such  that  half  of  each  of  the 
four  groups  of  raters  (supervisors-Munitions  Maintenance,  subordi- 
nates-Munitions  Maintenance,  supervisors-Fire  Protection,  subordi¬ 
nates- Fire  Protection)  reevaluated  lOtasks  using  either  the  categorical 
or  the  magnitude  estimation  scale. 

The  Lawlis  and  Lu  (1972)  approach  was  used  to  determine  the 
agreement  of  ratings  on  two  separate  occasions.  An  advantage  of  this 
technique  over  other  conventional  reliability  measurements  (e.  g.,  cor¬ 
relation)  is  in  its  power  to  measure  relationships  when  the  total  vari¬ 
ance  of  range  is  small,  as  is  often  the  case  with  rating  scales  and  in 
the  case  of  the  present  data  set.  Within  the  Lawlis  and  Lu  approach 
the  null  hypothesis  of  agreement  by  chance  is  tested  through  the  chi- 
square  formula  (with  one  degree  of  freedom): 


(Ni  -  Np 
Np" 


+  (N2  -  N  ( 1  -  p)  -  .5) 
N (1  -  p) 


where: 


number  of  abilities  being  rated 
number  of  observed  agreements 
number  of  observed  disagreements 
the  probability  of  k  judges  achieving 
agreement  by  chance 
correction  for  continuity 


A  statistically  significant  X“  value  indicates  that  the  observed 
agreement  is  not  due  to  chance.  The  p  value  in  the  formula  is  obtain¬ 
ed  from  a  table  of  probabilities  of  chance  agreement,  based  on  a  rec¬ 
tangular  distribution  model  (i.e.,  every  judgment  has  the  same  proba¬ 
bility  of  occurring  under  the  hypothesis  that  the  judges  have  no  under¬ 
standing  of  the  scale  and  their  ratings  are  random).  The  determina¬ 
tions  of  agreement  were  based  on  the  most  rigorous  criterion--identi- 
cal  ratings  on  the  two  occasions.  This  is  an  especially  stringent  cri¬ 
terion.  The  resultant  values  are  presented  in  Table  3-10. 


The  coefficients  of  agreement  resulting  from  this  analysis  were 
high  and  indicate  non-chance  agreement  over  the  two  occasions. 


Table  3-10 


Coefficients  of  Agreement  Between 
Two  Evaluations  of  the  Same  Tasks 


Rater 


Fire  Protection  (571XX) 

Supervisor,  amount-categorical 
Supervisor,  amount-magnitude 
Subordinate,  amount-categorical 
Subordinate,  amount-magnitude 

Supervisor,  performance  quality  variability-categorical 
Supervisor,  performance  quality  variability-magnitude 
Subordinate,  performance  quality  variability-categorical 
Subordinate,  performance  quality  variability-magnitude 


Munitions  Maintenance  (461XX) 

Supervisor,  amount-categorical 
Supervisor,  amount-magnitude 
Subordinate,  amount-categorical 
Subordinate,  amount-magnitude 

Supervisor,  performance  quality  variability-categorical 
Supervisor,  performance  quality  variability-magnitude 
Subordinate,  performance  quality  variability-categorical 
Subordinate,  performance  quality  variability-magnitude 


*  Statistically  significant  at  or  below  the  .01  level  of 


Chi-Square 


17.97* 

24.31* 

24.31* 

17.97* 

24.31* 

12.50* 

24.31* 

49.12* 


12.58* 

8.16* 

2.20 

49.12* 

49.12* 

2.20 

17.97* 

24.31* 


conf idence . 
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Inter  rater  Agreement 


Agreement  between  raters  was  calculated  for  each  perceptual/ 
psychomotor  taxonomic  class  by  rater  type  (supervisor  and  subordi¬ 
nate),  type  of  scale  (categorical  and  magnitude  estimation),  and  evalu¬ 
ative  factor  (amount  and  performance  quality  variability). 

To  accomplish  these  interrater  reliability  estimates,  tables  were 
constructed  which  contained  the  number  of  responses  for  each  scale  val¬ 
ue  selected  by  task.  In  this  process,  the  magnitude  estimation  scale  re¬ 
sponses  were  collapsed  into  five  category  units,  such  that  responses  be¬ 
tween  0  and  19  were  counted  as  response  category  1;  responses  between 
20  and  39  were  counted  as  response  category  2,  etc. 

To  determine  the  percentage  of  agreement  on  each  ability,  the 
following  steps  were  taken: 

1.  For  a  given  data  set  and  each  task  within  the 
set,  select  the  response  category  containing 
the  largest  number  of  responses  as  the  mod¬ 
ulus. 

2.  For  each  task,  sum  the  number  of  responses 
in  the  modulus  category  with  those  in  the  two 
response  categories  on  the  sides  of  the  mod¬ 
ulus  (if  the  modulus  is  the  first  or  last  re¬ 
sponse  category,  add  all  responses  in  the  two 
units  closest  to  the  modulus).  This  is  the 
agreement  sum. 

3.  Sum  the  agreement  sums  over  all  20  tasks. 

4.  Obtain  the  total  number  of  responses  made  for 
all  20  tasks  (e.g. ,  if  there  were  24  raters  and 
each  evaluated  20  tasks,  then  the  total  number 
of  possible  responses  is  480). 

5.  Divide  the  result  from  step  4  into  the  result 
from  step  3  to  obtain  the  percentage  of  agree¬ 
ment  among  raters. 

Tables  3-11  and  3-12  present  the  resultant  interrater  agreement 
percentages  for  the  categorical  scale  and  the  magnitude  estimation 
scale,  respectively.  The  average  percentage  of  agreement  was  obtain¬ 
ed  for  each  perceptual/ psychomotor  ability,  across  all  ratings  in  both 
specialties  and  separately  by  specialty,  rater  type,  and  evaluation  fac¬ 
tor.  The  two  tables  indicate  that  the  minimum  percentage  of  agreement 
was  76  on  both  the  categorical  and  magnitude  estimation  scales  for  the 
Position  Memory  ability  and  for  Visual  Memory  on  the  categorical  scale. 


Table  3-11 


Percentage  Agreement  Among 
Raters  for  the  Perceptual/ Psychomotor  Abilties 
_ on  the  Categorical  Scale  Judgments _ 
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Fire  Protection 

Supervisor  Subordinate 
A  PQV  A  PQV 


Munitions  Maintenance 

Supervisor  Subordinate 
A  PQV  A  PQV*  Mean 


FD 

75 

82 

74 

80 

87 

85 

79 

85 

81 

MD 

79 

78 

79 

76 

84 

89 

82 

83 

81 

CP 

82 

80 

73 

81 

87 

89 

89 

88 

84 

RC 

80 

79 

79 

80 
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90 
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85 
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84 

KM 

79 
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73 
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90 

97 

79 
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88 

81 
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Table  3-12 
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Percentage  Agreement  Among 
Raters  for  the  Perceptual/ Psychomotor  Abilities 
on  the  Magnitude  Estimation  Scale  Judgments 
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The  average  percentage  of  agreement  ranged  from  76  to  85  for  the  cat¬ 
egorical  scale  judgments  and  from  76  to  91  for  the  magnitude  estimation 
scale  judgments. 

The  agreement  among  the  raters,  in  all  cases,  seems  accepta¬ 
bly  high.  It  seems  that  the  raters  uniformly  understood  and  interpreted 
the  rating  methods  and  the  definitions  of  the  taxonomic  categories.  Such 
a  finding  supports  the  usefulness  of  the  methods  and  procedures  employ¬ 
ed. 


Intercorrelation  Among  Abilities 


The  taxonomic  classes  were  selected  with  consideration  of  uni¬ 
dimensionality  (uniqueness)  as  a  partial  criterion.  However,  some  in¬ 
sight  into  the  empirical  relationship  among  the  various  abilities  was 
required. 

The  perceptual/ psychomotor  ratings  were  intercorrelated  to  es¬ 
tablish  the  relationship  among  the  abilities.  The  resultant  intercorrela¬ 
tion  matrices  are  presented  as  Appendix  C  to  this  report. 

Frequency  distributions  (in  which  supervisor  and  subordinate 
data  were  combined)  of  the  results  are  presented  as  Tables  3-13  and 
3-14.  The  frequency  distributions  were  constructed  to  reflect  the  log¬ 
ic  that  the  class  interval  <  .  30  =  little  or  no  relationship,  the  class  in¬ 
terval  .31  to  .60  =  moderate  relationship,  and  >  .61  =  high  relationship. 
Most  of  the  intercorrelations  in  both  tables  are  in  the  below  .30  or  the 
.31  to  .60  ranges.  This  indicates  some  degree  of  independence  or  u- 
niqueness  among  the  perceptual/ psychomotor  abilities. 

The  perceptual/ psychomotor  taxonomic  classes  that  were  high¬ 
ly  intercorrelated  with  others  were  examined  to  determine  the  elements 
that  were  common  to  the  intercorrelated  abilities. 

Four  different  correlations  of  .80  or  above  occurred  with  some 
frequency  in  both  the  amount  and  performance  quality  variability  judg¬ 
ments.  These  involved  the  following  taxonomic  classes:  (a)  Manual 
Dexterity  and  Control  Precision,  (b)  Visual  Memory  and  Position  Mem¬ 
ory,  (c)  Visual  Speed  and  Accuracy  and  Position  Memory,  and  (d)  Au¬ 
ditory  Discrimination  and  Auditory  Memory.  The  common  elements  in 
the  Manual  Dexterity  and  ControL  Precision  abilities  are  the  arm  and 
hand  manipulations  and  movements.  The  major  difference  between  them 
is  that  in  one  case  objects  (such  as  tools  and  materials)  are  manipulated, 
whereas  control  mechanisms  (such  as  level's  and  pedals)  are  manipulat¬ 
ed  in  the  other.  The  obvious  common  element  in  the  VisuaL  Memory  and 
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Table  3-13 


Frequency  Distribution  of  Intercorrelations  Among 
_ Taxonomic  Classes  for  Amount 


Amount-Categorical  Scale 
Fire  Protection 


Correlation  N  Percent 


< 

.30 

26 

17 

•  31  - 

.60 

94 

60 

> 

.61 

36 

23 

156 

Munitions  Maintenance 

< 

.30 

95 

61 

.3?  - 

.60 

47 

30 

> 

.61 

14 

9 

156 

Amount-Magnitude  Estimation 

Scale 

Fire  Protection 

Correlation 

N 

Percent 

< 

.30 

16 

10 

.31  - 

.60 

65 

42 

> 

.61 

75 

48 

156 


< 

.30 

Munitions  Maintenance 

100 

64 

.31  - 

.60 

42 

27 

> 

.61 

14 

9 

156 
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Table  3-14 


Frequency  Distribution  of  Intercorrelations  Among 
Taxonomic  Classes  for  Performance  Quality  Variability 

Performance  Quality  Variability-Categorical  Scale 
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Fire  Protection 


Correlation 


N 


Percent 


< 

.30 

20 

13 

.h 

.60 

79 

51 

> 

.61 

57 

37 
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8 
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.60 

42 

27 

> 
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106 

68 

156 

Performance  Quality  Variability-Magnitude  Estimation  Scale 

Fire  Prote  tion 
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N 

Percent 

<  .30 

8 

5 

.31  -  .60 

43 

28 

>  .61 

105 

67 
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Munitions  Maintenance 


< 

.30 

28 

18 

.31  - 

-  .60 

80 

51 

> 

.61 

48 

31 

156 
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the  Position  Memory  classes  is  the  reliance  on  memory,  to  recall  things 
that  were  seen  in  the  past  for  the  first  class  and  to  recall  the  position 
of  things  from  past  experience  in  the  latter  class.  The  reason  for  the 
association  between  the  Visual  Speed  and  Accuracy  class  and  the  Posi¬ 
tion  Memory  class  is  not  entirely  dear.  Finally,  Auditory  Discrimina¬ 
tion  and  Auditory  Memory  share  the  common  element  of  sound  discrim¬ 
ination. 


Categorical  and  Magnitude  Estimation  Scale  Comparisons 


The  data  presented  in  prior  sections  suggested  somewhat  close 
agreement  in  the  results  produced  by  the  two  different  scaling  ap¬ 
proaches  employed  in  the  pretest.  Several  analyses  were  performed  to 
determine  the  statistical  relationship  between  the  two  different  rating 
scale  approaches. 

Table  3-15  presents  the  product  moment  correlation  between  the 
categorical  and  the  magnitude  estimation  scaling  for  various  situations. 
The  correlation  coefficients  were  considerably  higher  for  the  Munitions 
Maintenance  raters  as  opposed  to  the  Fire  Protection  raters.  Within 
both  specialties,  the  supervisors  tended  to  be  more  consistent  across 
the  rating  scales  than  their  subordinates.  However,  averaging  the  cor¬ 
relations  across  both  specialties  to  obtain  an  estimate  of  the  population 
value  resulted  in  a  relatively  high  degree  of  relationship  between  the 
two  scaling  approaches,  r=.80. 

The  relationship  between  the  two  scaling  procedures  was  further 
examined  visually.  Graphs  of  the  mean  results  from  the  two  scaling  ap¬ 
proaches  are  presented  in  Figures  3  - 1  through  3 -4.  To  plot  the  two  sets 
of  results  on  the  same  axes,  a  set  of  equivalencies  of  scale  interval 
midpoints  was  established.  The  magnitude  estimation  scale  was  divid¬ 
ed  into  five  segments:  0  to  19,  20  to  39,  40  to  59,  00  to  79,  and  80  to 
100,  and  the  midpoint  of  each  magnitude  estimation  scale  segment  was 
equated  to  each  scale  point  on  the  categorical  scale  in  the  following 
manner; 

Magnitude  Midpoint  Categorical  Scale  Value 

10 
30 
50 
70 
90 


1 

2 

3 

4 
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The  supervisor  and  subordinate  judgments  were  combined. 


Table  3-15 


Product  Moment  Correlation  Between  Categorical  and 
Magnitude  Estimation  Scaling  Approaches  (N  =  13  Abilities) 


Fire  Protection 

Variable  2L 

Supervisors,  amount  *53 

Supervisors,  performance  quality  variability  .61 

Subordinates,  amount  *90 

Subordinates,  performance,  quality  variability  .52 

Meanr  =  . 69 


Munitions  Maintenance 


Supervisors,  amount  *96 
Supervisors,  performance  quality  variability  *86 
Subordinates,  amount  *91 
Subordinates,  performance  quality  variability  .64 


Meanr  *  . 88 

Grand  Meanr  **  ,  80 
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The  graphs  all  show  close  similarities  in  shape  and  elevation 
with  the  exception  of  Auditory  Memory  in  Figure  3-3. 

Both  the  correlational  data  and  the  graphic  presentations  sug¬ 
gest  that  the  task-taxonomic  category  judgments  are  not  method  sensi¬ 
tive.  This  holds  for  both  the  amount  and  the  performance  quality  vari¬ 
ability  factors. 

Properties  of  Scales 

Another  set  of  insights  into  the  nature  of  the  scales  provided  by 
the  two  scaling  approaches  is  provided  by  plotting  the  means  in  ascend¬ 
ing  order  and  showing  the  standard  deviation  of  each  mean  on  the  same 
plot.  If  the  standard  deviations  increase  at  the  scale  extremes,  there 
is  a  suggestion  that  the  raters  are  more  sensitive  to  the  scale  extremes 
than  to  the  central  area.  Such  a  scale  property  is  not  usual  in  psycho¬ 
logical  continua  but  is  usual  for  physical  continua.  Quite  obviously  scales 
of  the  latter  type  (prothetic  scales)  do  not  possess  a  constant  Weber 
function  and  are  less  preferred  than  scales  of  the  former  type  (meta- 
thetic  scales). 

The  data  in  Tables  3-3  and  3-4  are  presented  graphically  in  Fig¬ 
ures  3-5  and  3-6.  As  a  result  of  the  agreement  between  the  supervisor 
and  subordinate  judgments,  as  indicated  by  the  prior  analyses,  the  judg¬ 
ments  of  the  two  groups  of  judges  were  combined.  The  graphs  present 
the  13  ability  means,  and  their  standard  deviations,  in  an  ascending 
scale  value  order.  Separate  graphs  are  presented  for  the  amount  and 
performance  quality  variability,  on  each  of  the  two  types  of  rating  scales, 
for  each  of  the  two  specialties  pretested. 

In  addition,  the  graphs  of  the  mean  data  place  the  13  abilities  in 
a  perspective  relationship  to  each  other.  For  example.  Figure  3-5  in¬ 
dicates  several  abilities  that  are  high  on  the  amount  of  the  abilities  re¬ 
quired  to  perform  the  listed  tasks  (e.g. ,  Manual  Dexterity,  Visual  Mem¬ 
ory,  Position  Memory)  and  several  that  are  low  on  the  amount  of  the 
abilities  required  (e.g,.  Clerical  Perception  and  Kinesthetic  Memory). 
The  plots  indicate  almost  constant  standard  deviations  regardless  of 
type  of  scale  (categorical  or  magnitude)  or  factor  judged  (amount  or  per¬ 
formance  quality  variation).  This  suggests  the  utility  of  either  type  of 
scale  for  job  analytic  studies  of  the  present  type. 

Combined  Profiles 

Figures  3-5  and  3-6  presented  separate  profiles  of  the  amount 
and  the  performance  quality  variability  involvement  of  the  abilities 


FD  =  Finger  Dexterity  PM  =  Position  Memory 

AD  =  Auditory  Discrimination  MD  =  Manual  Dexterity 

CP  =  Control  Precision  AM  =  Auditory  Memory 

RC  =  Rate  Control  DP  =  Depth  Perception 

VM  =  Visual  Memory  DA  =  Divided  Attention 

VSA=  Visual  Speed  and  Accuracy  KM  =  Kinesthetic  Memory 

CLP  =  Clerical  Perception 

Figure  3-5.  Means  and  standard  deviations  of  taxonomic 
classes  for  Fire  Protection  career  field. 
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SCALE  VALUE  MEAN  SCALE  VALUE 


FD  =  Finger  Dexterity 
AD  =  Auditory  Discrimination 
CP  =  Control  Precision 
RC  =  Rate  Control 
VM  =  Visual  Memory 
VSA  =  Visual  Speed  and  Accuracy 


CLP  =  Clerical  Perception 


PM  =  Position  Memory 
MD  =  Manual  Dexterity 
AM  =  Auditory  Memory 
DP  =  Depth  Perception 
DA  =  Divided  Attention 
KM  =  Kinesthetic  Memory 


Figure  3-6.  Means  and  standard  deviations  of  taxonomic  classes 
for  Munitions  Maintenance  career. 
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represented  by  each  taxonomic  class  in  the  two  technical  specialties. 
Another  approach  to  portraying  the  taxonomic  class  involvement  is  to 
combine  the  amount  and  the  performance  quality  variability  data  into  one 
overall  index.  The  combinatorial  approach  selected  was  the  geometric 
mean: 

Total  Involvement  =  +  PQV^  ) 

where:  A  =  amount 

PQV  =  performance  quality  variability 

This  is  the  familiar  "city  block"  model  which  considers  the  two 
vectors  to  be  orthogonal.  Of  course,  other  combinatorial  techniques 
are  possible  and  possibly  more  defensible. 

The  combined  profiles  are  presented  as  Figures  3-7  and  3-8. 
These  represent  the  overall  involvement  of  the  taxonomic  classes  in 
each  of  the  two  Air  Force  career  fields  included  in  the  pretest. 


Interview  Findings 


A  semistructured  interview  was  conducted  with  24  of  the  super¬ 
visors  and  subordinates  who  participated  in  the  major  pretest  data  col¬ 
lection  effort.  The  interview  attempted  to  inquire  into  problems  associ¬ 
ated  with  the  data  collection  techniques,  the  alternate  scaling  approaches, 
the  taxonomy,  and  the  like  from  the  point  of  view  of  the  respondent. 

Two  abilities  were  suggested  in  response  to  the  question  "What 
other  perceptual/ psychomotor  abilities  are  required  in  the  performance 
of  tasks  that  were  not  contained  in  the  data  collection  forms?  "  Most  re¬ 
spondents  thought  that  the  taxonomy  was  complete  and  thorough.  Several 
interviewees,  in  both  career  fields,  suggested  that  strength  and  physical 
stamina^  were  important,  e.  g. ,  for  the  continued  handling  of  heavy  mu¬ 
nitions  in  the  Munitions  Maintenance  career  field  and  in  the  rescue  of 
personnel  (described  as  an  activity  that  "exhausts  and  drains  people 
quickly")  in  the  Fire  Protection  career  field.  One  person  suggested  that 
color  perception  might  be  an  important  consideration  in  the  Fire  Protec¬ 
tion  specialty,  especially  for  reading  hazard  codes.  On  balance,  the  in¬ 
terviewees  were  largely  of  the  opinion  that  the  13  abilities  included  in  the 
taxonomy  were  a  complete  and  satisfactory  listing  of  perceptual/ psycho¬ 
motor  abilities  involved  in  job  performance  in  their  career  fields. 


2 

A  strength  requirements  survey  was  taking  place  at  about  the  same 
time  as  the  present  work. 


CO 


FD  =  Finger  Dexterity 
MD  =  Manual  Dexterity 
CP  =  Control  Precision 
RC  =  Rate  Control 
VM  =  Visual  Memory 
VSA  =  Visual  Speed  and  Accuracy 


PM  =  Position  Memory 
AD  =  Auditory  Discrimination 
AM  =  Auditory  Memory 
CLP  =  Clerical  Perception 
DP  =  Depth  Perception 
DA  =  Divided  Attention 


KM  =  Kinesthetic  Memory 


Figure  3-8.  Involvement  of  perceptual /psychomotor  abilities 
in  Munitions  Maintenance  career  field. 
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Several  interviewees  alluded  to  the  possibility  that  different 
amounts  of  an  ability  could  be  required  at  different  locations.  For  ex¬ 
ample,  Fire  Protection  personnel  may  have  more  occasion  to  use  the 
"Divided  Attention"  ability  at  large  air  bases  because  of  (a)  the  more 
complex  communications  systems  at  such  a  location  and  (b)  the  greater 
number  of  radios  being  attended  at  the  same  time.  A  Munitions  Main¬ 
tenance  interviewee  suggested  that  the  amount  of  "Manual  Dexteriiy" 
couli  vary  from  base  to  base,  depending  on  the  amount  of  heavy  versus 
light  munitions  that  were  handled.  This  suggests  the  need  for  including 
a  variety  of  bases  in  surveys  such  as  the  present  one.  The  interviewees 
who  made  these  suggestions  all  have  been  assigned  to  other  bases  prior 
to  their  current  assignment.  Consequently,  their  suggestions  were, 
more  than  likely,  based  on  personal  experience  rather  than  conjecture 
or  supposition. 

An  evaluation  of  the  perceptual/ psychomotor  definitions  (ques¬ 
tion  6)  indicated  that  all  the  interviewees  understood  the  definitions  ad¬ 
equately  and  were  able  to  relate  them  to  the  tasks  performed  in  their 
career  field.  One  interviewee  suggested  that  the  examples  offered  in 
the  definitions  list  might  be  more  meaningful  if  they  pertained  to  motor 
vehicles,  such  as  cars  and  trucks,  rather  than  aircraft. 

The  interviewees  were  presented  with  a  list  of  10  adjectival  state¬ 
ments  (question  7);  five  were  positive  statements  and  five  were  negative. 
The  statements  appeared  in  a  random  order  in  the  list.  The  interviewees 
were  asked  to  select  any  two  statements  which  best  described  their  opin¬ 
ion  of  the  category  scale  and  another  two  statements  which  best  described 
their  opinion  of  the  magnitude  estimation  scale.  The  distribution  of  re¬ 
sponses,  by  career  field  and  by  supervisor -subordinate,  indicated  such 
minor  differences  that  the  responses  were  grouped  (across  both  special¬ 
ties  and  level)  for  summary  purposes.  The  data  indicated  a  positive  dis¬ 
position  toward  the  category  scale.  A  total  of  96  responses  was  record¬ 
ed  (four  responses  from  each  interviewee,  two  for  each  type  of  scale). 

Of  the  total  number  of  responses,  54  (56%)  were  positive,  while  42  (44%) 
were  negative.  Of  the  positive  responses,  38  (70%)  favored  the  category 
scale  over  the  magnitude  estimation  scale.  Similarly,  of  the  negative 
responses,  32  (70%)  were  more  negative  toward  the  magnitude  estimation 
scale.  An  alternative  view  of  these  data  is  that  when  considering  only 
the  category  scale  evaluations,  38  (79%)  of  the  responses  were  favor¬ 
able;  when  the  evaluations  of  the  magnitude  estimation  scale  were  an¬ 
alyzed,  16  (33%)  were  positive.  On  the  basis  of  response  frequency, 
the  three  statements  that  best  characterize  the  opinions  of  the  category 
scale,  respectively,  were  "easy  to  use,  "  "easy  to  interpret,  "  and  "a 
good  approach.  "  Conversely,  the  three  most  frequently  selected  options 
describing  opinions  of  the  magnitude  estimation  scale  were  "difficult  to 
use,  "  "provides  inadequate  information,  "  and  "poor  approach.  " 


The  interviewees  were  asked  to  evaluate  the  difficulty  they  had 
in  using  the  two  scaling  approaches  (question  8).  They  selected  one  op¬ 
tion  from  five,  which  best  described  their  opinion  on  the  difficulty  is¬ 
sue.  The  responses  on  the  difficulty  issue  appear  to  mirror  those  giv¬ 
en  in  response  to  the  preference  question.  Approximately  twice  as  many 
interviewees  (2 1  versus  12) rated  the  category  scale  as  easier  ("moder¬ 
ately"  or  "very").  In  a  similar  vein,  five  times  as  many  interviewees 
(9  versus  2)  rated  the  magnitude  estimation  as  difficult.  The  remaining 
responses  fell  in  the  "neither  difficult  nor  easy"  option.  However,  in 
general,  both  scales  were  considered  somewhat  easy  to  use.  Three 
times  as  many  of  the  interviewees  (33  versus  ll)selected  the  "very  easy" 
or  "moderately  easy"  options  rather  than  the  "difficult"  options  for  both 
scales. 


Several  suggestions  were  made  by  the  interviewees  regarding 
the  two  types  of  scales.  The  comments  shed  additional  light  on  the  is¬ 
sue  of  the  type  of  scale  which  is  most  acceptable  from  the  point  of  view 
of  the  respondent: 

•  It  is  difficult  to  use  percentages  [magnitude  es¬ 
timation  scale  J. 

•  There  are  too  many  choices  to  consider  [magni¬ 
tude  estimation  scale  J. 

•  I  can't  nail  down  an  answer  and  be  exact  with  the 
magnitude  scale. 

•  Don't  include  the  percentages  in  the  category 
scale  -  it's  confusing  and  too  much  like  the  mag¬ 
nitude  scale. 

An  open-ended  question  was  asked  in  order  to  obtain  suggestions 
for  improving  the  final  data  collection  instruments.  Some  of  the  sugges¬ 
tions  were: 

•  Use  only  Part  I  [  amount  J.  I  got  confused  be¬ 
tween  the  two  concepts  and  had  to  concentrate 
very  hard  on  the  quality  of  performance  section. 

•  Section  II  [performance  quality  variability]  was 
very  difficult.  I  had  to  read  it  twice  to  under¬ 
stand  it. 

•  It  was  difficult  at  first.  But  after  the  second  col¬ 
umn  it  was  easy. 


•  Place  the  scales  on  the  pages  that  have  to  be  filled 
out. 


•  Make  the  examples  in  the  definition  list  specific 
to  my  career  field. 

•  Don't  use  perceptual/ psychomotor.  TJse  terms 
like  skill  or  ability. 

The  procedures  employed  in  the  administration  of  the  forms 
and  the  data  collection  instruments  themselves  including  the  definitions 
of  taxonomic  classes)  were  largely  acceptable  to  the  pretest  sample  of 
respondents  and  appeared  to  require  only  minor  modifications  to  im¬ 
prove  clarity  and  meaningfulness  (e.g. ,  wording). 

Discussion  of  Pretest  Results 

Probably,  the  major  purpose  of  the  pretest  was  to  determine 
whether  or  not  the  task  list  approach  represents  a  workable  technique 
for  collecting  taxonomic  class  involvement  information  for  Air  Force 
specialties.  From  the  overall  point  of  view,  it  seems  that  the  technique 
was  successful  for  acquiring  the  required  data.  The  supervisors  and 
the  subordinates  who  were  involved  were  able  to  understand  the  taxono¬ 
my,  the  scaling  procedures,  and  the  methods  for  completing  the  forms. 

Other  issues  were  also  involved  in  the  pretest  investigations. 
The  first  of  issues  related  to  the  sensitivity/ discriminating  power  of  the 
scales/taxonomy.  There  was  some  indication  that  the  range  of  responses 
was  restricted- -especially  relative  to  taxonomic  classes.  This  restric¬ 
tion  may  be  a  true  representation  of  the  different  ability  requirements 
or  it  may  represent  a  scaling  problem.  The  safer  course  seemed  to  be 
to  accept  the  latter  explanation  and  to  make  some  modifications  in  the 
scaling  procedure  for  the  subsequent  large  scale  data  collection  effort. 
On  the  other  hand,  when  tasks  were  judged  across  taxonomic  classes, 
the  range  restriction  was  not  so  pronounced.  This  finding  supports  the 
use  of  the  task  approach  that  was  adopted  at  the  outset. 

A  second  specific  issue  involved  the  independence  of  two  consid¬ 
erations:  the  amount  of  a  taxonomic  class  required  for  task  performance 
and  the  performance  quality  variability  produced  by  the  class.  The  re¬ 
sults  indicated  a  moderate  association  between  the  results  yielded  by 
the  two  factors.  There  was  some  indication  that  the  subordinates  were 
better  able  than  their  supervisors  to  distinguish  between  the  amount  and 
the  performance  quality  variability  factors.  However,  the  two  factors 
seemed  to  be  sufficiently  independent  to  warrant  continuation  of  the  use 
of  both  factors  during  the  extended  data  collection  planned  for  the  next 
research  phase. 


There  was  evidence  supporting  the  test -retest  reliability  of  the 
techniques  and  the  interrater  reliability  seemed  acceptably  high.  The 
pretest  data,  in  this  regard,  support  the  use  of  the  methods/ techniques 
of  the  oretest  during  later  study  phases. 

Some  indication  was  shown  of  a  statistical  relationship  among 
the  13  taxonomic  classes  but  the  associations  were,  for  the  most  part, 
not  strong.  Moreover,  the  respondents  said  that  they  had  little  difficul¬ 
ty  in  understanding  or  employing  the  taxonomy.  With  this,  as  well  as 
the  obtained  reliability,  in  mind,  revision  of  the  taxonomy  did  not  seem 
warranted  at  this  juncture. 

The  issue  of  the  relationship  between  estimates  made  by  super¬ 
visory  as  compared  to  subordinate  personnel  was  investigated  from  a 
number  of  points -of-view.  In  general,  there  was  a  close  relationship 
between  the  taxonomic  information  yielded  by  supervisors  and  by  sub¬ 
ordinates  whether  type  of  scaling  procedure,  career  field,  taxonomic 
class,  or  rating  factor  was  involved.  The  overall  indication  seemed 
to  be  that  the  data  yielded  by  the  two  personnel  levels  will  be  essential¬ 
ly  equivalent  and  that  either  or  both  subject  groups  could  form  the  basis 
for  the  data  to  be  collected  in  subsequent  study  phases. 

Similarly,  there  seemed  to  be  little  effect  of  type  of  scaling  pro¬ 
cedure  on  the  emergent  data  regardless  of  rating  factor.  However,  the 
categorical  scaling  procedure  seemed  preferred  over  the  magnitude  pro¬ 
cedure  by  the  repondents.  Accordingly,  it  seemed  that  the  categorical 
procedure  should  be  employed  in  subsequent  data  collection  efforts. 

All  of  this  suggested,  that  with  some  modification  in  wordings 
and  scaling,  judgments  possessing  adequate  quality  could  be  obtained 
in  subsequent  work  phases. 
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IV.  PERCEPTUAL/ PSYCHOMOTOR  REQUIREMENTS 

OF  35  AFSCS 


With  the  results  of  the  pretest  of  methods  and  procedures  on 
hand,  a  major  effort  to  acquire  information  about  the  perceptual/ psycho¬ 
motor  requirements  of  Air  Force  specialties  was  instituted. 


Changes  in  Forms  and  Procedures 


On  the  basis  of  the  pretest  results,  it  was  decided  to  employ 
the  categorical  rating  procedure  during  the  major  effort.  This  scale 
seemed  to  yield  data  of  equivalent  quality,  as  compared  with  the  magni¬ 
tude  estimation  procedure,  and  to  be  easier  and  more  acceptable  to  the 
respondents.  However,  in  an  effort  to  increase  the  range  of  responses, 
two  additional  categories  were  added  to  the  scale  - -extending  it  from  a 
five  category  to  a  seven  category  scale.  Additionally,  and  for  the  same 
purpose,  the  percentage  values  contained  in  the  definitions  were  deleted. 
Otherwise,  the  methods  and  procedures  of  the  data  acquisition  remained 
the  same  as  for  the  pretest. 


Sample 


Career  Fields 


A  sample  of  35  Air  Force  career  fields  was  selected  for  inclu¬ 
sion  in  the  present  work.  To  obtain  this  sample,  the  Airman  Classifica¬ 
tion  Manual  (AFM  39-1)  was  initially  reviewed  to  develop  an  ad  hoc  list 
that  would  contain  career  fields  in  which  different  types  of  perceptual/ 
psychomotor  requirements  seem  needed  (e.g. ,  manual  dexterity,  visual 
memory,  clerical  perception).  This  list  consisted  of  75  career  fields. 

All  specialties  which  did  not  possess  an  Occupational  Survey  Re¬ 
port  task  listing  were  eliminated  from  further  consideration.  The  final 
sample  was  selected  from  the  remaining  set  of  55  on  the  basis  of  apti¬ 
tude  requirements  for  entry  into  the  career  fields. 

The  four  aptitude  areas  used  by  the  Air  Force  to  group  career 
fields  are  mechanical,  administrative,  general,  and  electronics.  The 
aptitude  minimums  for  each  career  field  were  listed  hierarchically  with¬ 
in  each  of  the  four  aptitude  areas.  The  distribution  was  then  divided  in¬ 
to  three  approximately  equal  segments.  The  highest  group  of  minimum 
aptitude  scores  was  labelled  H  (high);  the  middle  group  was  labelled  M 
(moderate)  and  the  lowest  group  was  labelled  L  (low).  The  arrangement 
of  cutoff  points  of  aptitude  scores,  for  each  aptitude  area  was; 
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Mechanical 


High:  60  or  above 

Medium:  50-59 
Low:  40  or  below 


Administrative 


High; 

Medium: 

Low; 

7  0  or  above 
50-69 

40  or  below 

General 

High; 

Medium: 

Low; 

70  or  above 

50-69 

40  or  below 

Electronics 

High: 
Medium: 
Low ; 

60  or  above 
50-59 

40  or  below 

The  final  selection  of  career  fields  is  presented  in  the  matrix 
shown  as  Table  4-1.  The  career  fields  sampled  reflect  an  equal  repre¬ 
sentation  of  each  of  the  aptitude  areas  and  of  the  high,  medium,  and  low 
cutoff  points  on  the  aptitude  score  requirements.  Where  more  than  one 
career  field  was  available  for  selection,  that  career  field  was  selected 
which  had  a  larger  number  of  personnel  assigned.  At  the  time  of  the 
sample  selection,  the  range  of  personnel  (including  the  skill  levels  3 
through  9)  for  the  career  fields  listed  was  527  to  28,337.  The  career 
fields  in  Table  4-1  were  identified  for  the  3 -and  5 -skill  levels. 

Air  Force  Bases 

Following  the  career  field  sample  selection,  the  next  sample  to 
be  selected  was  Air  Force  bases.  The  intent  in  sampling  bases  was  to 
conduct  surveys  at  a  variety  of  bases  so  that  geographic  and  situational 
differences,  if  any,  could  be  represented  in  the  ultimate  data.  A  second 
consideration  in  the  air  base  selection  was  the  air  base's  major  com¬ 
mand,  e.g..  Strategic  Air  Command  (SAC),  Tactical  Air  Command 
(TAC),  or  Military  Air  Command  (MAC).  Table  4-2  shows  the  Air  Force 
base  sample. 
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Table  4-1 


Sample  of  Air  Force  Career  Fields  by 
_ Aptitude  Score  Minimumus _ 


Mechanical 


Administrative 


General 


Electronics 


High 

Medium 

Low 

JSZ 

461X0  (Munitions  Main¬ 

605X0  (Air  Passenger 

603X0  (Vehicle  Opera¬ 

tenance) 

and  Air  Cargo  Special¬ 
ist) 

tor  /Dispatcher) 

462X0  (Weapons  Mechan¬ 

ic) 

8 

* 

114X0  (Aircraft  Load- 

631X0  (Fuels  Specialist) 

master) 

443X0  (LGM  25  Missile 

552X0  (Carpentry  and^ 

Mechanic) 

Masonry  Specialist)* 

651X0  (Procurement 

293X3  (Radio  Operator) 

702X0  (Airman  Adminis¬ 

Specialist) 

701X0  (Chapel  Manage¬ 

732X0  (Personnel) 

tration) 

ment) 

705X0  (Legal  Services) 

272X0  (Air  Traffic 

611X0  (Supply  Services) 

9 

Control  Operator 
Technician) 

271X0  (Airport  Air 

Operations) 

204X0  (Intelligence 

645X0  (Inventory  Man¬ 

571X0  (Fire  Protection) 

Op, radon,  and  Imagery 

agement  ,  Materiel 

Interpretation) 

Fecllltlea  and  Supply 

Systems) 

251X0  (Weather  Fore¬ 

902X0  (Medical  Services) 

231X1  (Craphica) 

9 

caster)8 

291X0  (Information 

981X0  (Dental  and  Pre¬ 

231X2  (Still  Photo¬ 

Specialist)^ 

ventive  Dentistry 
Technician)0 

graphic) 

316XOC  (Missile  Elec¬ 

541X0/G  (Missile  Fa¬ 

423X0  (Aircraft  Elec¬ 

tronic  Equipment  Spe¬ 
cialist)^ 

cilities) 

trical  Systems  Special¬ 
ist) 

325X1  (Avonic  Instru¬ 

542X0  (Electrician) 

423X3  (Aircraft  Fuel 

9 

ment  Systems  Special¬ 

Systems  Mechanic) 

ist) 

304X4  (Ground  Radio 

542X2  (Electrical 

426X2  (Jet  Engine 

Equipment  Repair) 

Power  Production) 

Mechanics) 

11 

12 

L2 

35 

•Missing  cell — no  task  list  available  for  additional  career  flelda 


Air  Force  Designations:  A.  Carpentry  Specialist  and  Masonry  Specialist 

B.  Changed  to  Weather  Specialist 

C.  Inf  o  mat  ion /His  tor  lan  and  Radlo/Televlalon  Boradcastlng 

D.  Dental  Specialist  and  Preventive  Dentistry  Specialist 

£.  Missile  Electronic  Equipment  Specialist,  G  and  H  Shreds, 
Missile  Systems  Analyst,  G  Shred 


Table  4-2 


Air 

Force  Base  Sample 

Air  Base 

Location 

Function 

Davis-Montban 

Arizona 

SAC 

Nellis 

Nevada 

TAC 

Litcle  Rock 

Arkansas 

TAC 

Pope 

North  Carolina 

TAC 

Hurlburt 

Florida 

TAC 

Bergstrom 

Texas 

TAC 

K. I.  Sawyer 

Michigan 

SAC 

Grand  Forks 

North  Dakota 

SAC 

Malmstrom 

Montana 

SAC 

McGuire 

New  Jersey 

MAC 
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Respondent  Sample 


The  respondent  sample  selection  was  considered  next.  On  the 
basis  of  the  results  of  the  pretest,  both  supervisor  (E-6  and  above)  and 
subordinate  (E-5  and  below)  job  incumbents  were  selected  for  inclusion 
in  the  sample.  Selection  was  from  a  central  locator  file.  For  the  incum¬ 
bents  to  be  sampled  at  a  base,  the  base  was  supplied  with  a  list  which 
contained  the  incumbents'  names,  grades,  and  career  fields  (in  a  numer¬ 
ical  code).  At  the  outset,  the  goal  was  to  select  a  total  of  15  supervisors 
and  15  subordinates  in  each  career  field.  When  a  selected  job  incumbent 
was  not  available,  the  designated  project  officer  at  each  base  was  re¬ 
quested  to  make  an  equivalent  substitute.  If  an  equivalent  substitution 
could  not  be  made,  then  a  reasonable  substitute  having  the  same  AFSC 
as  the  originally  selected  incumbent  was  requested.  In  some  cases, 
substitution  was  not  possible. 


Task  Sample 

The  task  list  included  in  the  survey  form  for  each  career  field 
was  designed  to  be  both  representative  of  the  tasks  performed  on  the 
job  and  to  be  of  a  length  which  would  not  overburden  the  respondents  in 
terms  of  the  time  required  for  completion.  Completion  time  informa¬ 
tion  was  taken  for  each  airman  who  participated  in  the  pretest.  On  the 
basis  of  these  data  and  a  decision  that  about  2.  5  to  3.  0  hours  represent¬ 
ed  the  maximum  length  for  any  data  collection  session,  a  60-task  list 
length  was  selected.  A  random  selection  method  was  used  to  develop, 
for  each  career  field,  a  list  that  would  be  representative  of  and  general- 
izable  to  the  total  AFSC.  A  table  of  random  numbers  was  used  to  com¬ 
plete  the  random  selection  process. 

Tasks  were  selected  from  the  task  listing,  provided  by  the  OSRs, 
for  the  5 -skill  level  of  each  career  field.  Since  the  duty  categories  of 
supervision,  planning,  and  training  involve  functions  often  assigned  to 
high  level,  senior  incumbents,  tasks  falling  in  these  categories  were 
not  included  in  the  sampling  process.  Each  of  the  remaining  tasks  list¬ 
ed  in  the  OSRs  was  numbered  and  a  table  of  random  numbers  was  used 
to  identify  those  tasks  for  inclusion  in  the  final  list  for  a  c  areer  field. 
Accordingly,  each  final  task  list  consisted  of  a  set  of  operational  activ¬ 
ities  common  to  the  AFSC  in  question. 

A  downstream  problem  that  could  result  from  the  procedure  was 
that  if  changes  were  introudced  in  the  AFSC  (between  the  time  of  devel¬ 
opment  of  the  OSR  and  the  present  work),  the  final  list  could  then  con¬ 
sist  of  tasks  which  are  no  longer  performed  and  are  perhaps  unfamiliar 
to  some  responding  airmen.  To  accommodate  the  respondents  who 
would,  as  a  result,  be  unfamiliar  with  certain  tasks,  a  "Don't  Know"  re¬ 
sponse  was  included  in  the  response  options. 
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Data  Collection  Instruments 


Content  of  Data  Collection  Forms 


As  stated  above,  for  this  data  collection  effort,  several  modifi¬ 
cations  were  made  to  the  pretest  forms  on  the  basis  of  the  pretest  in¬ 
dications.  Thses  modifications  involved  wording  changes  made  in  the 
interest  of  improved  clarity,  the  exclusion  of  the  magnitude  estimation 
scaling  approach,  the  use  of  a  "Don't  Know"  response  category  instead 
of  the  "N"  (not  performed  in  the  squadron)  response,  and  the  extension 
of  the  category  scale  from  five  units  to  seven  intervals. 

The  scale  of  values  used  in  the  final  survey  instruments  ranged 
from  "1 " (very  little),  through  "7"  (very  high),  with  the  scale  value  "4" 
(moderate)  anchoring  the  midpoint. 3  The  scale  was  presented  to  the  re¬ 
spondents  in  the  survey  form  instructions  and  also  on  a  card,  which  the 
respondents  kept  before  them  as  they  completed  their  form.  Exhibit  4-t 
presents  the  scale  card  used  by  the  respondents  when  they  completed 
the  amount  and  the  performance  quality  variability  sections  of  the  sur¬ 
vey  form. 

The  response  sheets  were  identical  for  both  parts  of  the  form. 
The  same  format  was  used  as  was  employed  in  the  pretest.  The  60 
tasks  were  arranged  vertically  along  the  left  side  of  a  page,  20  tasks 
per  page.  The  respondents  had  a  total  of  1,  560  judgments  to  make;  60 
tasks  x  13  abilities  x  2  survey  form  sections. 


Demographic  Information 


The  cover  page  of  each  data  collection  form  was  coded  with  the 
appropriate  AFSC.  The  cover  page  also  asked  for  the  name,  rank, 
squadron,  and  location  of  the  airman  completing  the  form.  Additional¬ 
ly,  the  respondents  indicated  how  long  they  have,  been  in  their  career 
field  and  the  number  of  years  they  have  been  in  the  Air  Force. 


Procedures 


Preparatory  Step 


A  letter  of  introduction  prepared  by  Air  Force  Human  Resources 
Laboratory,  Brooks  Air  Force  Base  was  forwarded  to  each  base  several 
weeks  prior  to  the  survey  start.  A  copy  of  this  letter  is  presented  as 
Appendix  F  to  this  report. 


Q 

The  NR  response  ("ability  is  not  reqt  .red  in  duty  performance")  was 
entered  as  a  zero  in  the  subsequent  data  analyses. 
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Exhibit  4-1.  Scales  used  for  parts  1  and  2  of  the  data  collection  forms. 


Within  two  weeks  after  the  introductory  letter  was  transmitted, 
the  appropriate  air  base  was  contacted  and  arrangements  were  complet¬ 
ed  for  the  survey  completion.  Survey  completion  at  each  air  base  took 
from  two  to  five  days  and  the  same  procedures  were  employed  as  in  the 
pretest.  Data  collection  sessions  were  of  the  group  administration  na¬ 
ture  and  the  sessions  were  scheduled  at  the  convenience  of  the  air  bases 
involved. 

Administrator  Instructions 

The  same  set  of  administrator  instructions  as  used  in  the  pre¬ 
test  were  used  in  administering  the  final  forms.  The  only  change  intro¬ 
duced  was  in  the  sixth  point  of  step  6  (explain  the  respondent's  task). 
This  instruction  read  as  follows: 

There  are  yellow  cards  contained  in  each  booklet 
that  have  the  scale  values  you  are  to  use  when  mak¬ 
ing  your  judgments  (demonstrate).  The  values  range 
from  1  to  7.  If  you  ar  e  of  the  opinion  that  a  partic¬ 
ular  skill  is  not  required  in  the  performance  of  a 
task,  then  you  would  enter  "NR"  in  the  appropriate 
box  (demonstrate).  There  is  also  a  don't  know  re¬ 
sponse  which  you  can  use  if  you  really  do  not  know 
anything  about  the  task.  Use  the  "DK"  response 
only  if  you  know  nothing  about  the  task.  Make  every 
effort  to  enter  a  judgment,  even  if  you  don't  per¬ 
form  the  task  yourself  and  never  did.  We  are  not 
interested  in  what  you  personally  do  on  the  job-- 
only  in  what  you  know  about  the  performance  of  the 
tasks  on  the  list.  Your  knowledge  of  thses  tasks 
could  have  come  from  your  training,  observation, 
or  past  performance.  Try  to  respond  in  every  in¬ 
stance  with  a  scale  value. 


Demographic  Description  of  Sample 

Survey  forms  were  completed  by  808  airmen  in  35  Air  Force 
Specialty  Codes  (AFSCs)  in  four  aptitude  areas  (mechanical,  administra¬ 
tive,  general,  and  electronics),  sampled  at  10  Air  Force  bases.  The 
final  sample  represented  80%  of  the  1008  airmen  identified  for  partici¬ 
pation  in  the  survey. 

The  percentage  of  completed  survey  forms  from  the  10  air  bas¬ 
es  ranged  from  04  to  89  with  a  median  of  77.50.  With  the  exception  of 
an  "oversampling"  in  Carpentry  and  Masonry  Specialist  and  the 


coincidence  of  actual  size  with  requested  sample  size  in  Procurement 
Specialist,  "undersampling"  in  the  remaining  33  AFSCs  ranged  from  7 
to  50  percent  with  a  median  of  22  percent. 

The  eight  AFSCs  in  the  mechanical  aptitude  area  contributed  181 
out  of  808  (22%)  airmen  to  the  total  sample;  the  nine  AFSCs  in  the  ad¬ 
ministrative  aptitude  area  contributed  206  (25%)  airmen  to  the  total  sam¬ 
ple,  the  nine  AFSCs  in  the  general  aptitude  area  contributed  203  (25%) 
airmen  to  the  final  sample;  and  nine  AFSCs  in  the  electronics  area  con¬ 
tributed  218  (27%)  airmen  to  the  final  sample.  Thus,  the  four  aptitude 
areas  were  approximately  equally  represented  in  the  total  sample.  Each 
of  the  four  areas  contributed  about  one  quarter  of  the  total  final  sample. 

Supervisor  Description 


Three  hundred  and  seventy  supervisors  (46%)  participated  in  the 
final  survey.  The  frequency  of  supervisors  in  the  35  AFSCs  in  the  four 
aptitude  areas  together  with  median  and  modal  coded  number  of  years  in 
an  AFSC  and  years  in  the  Air  Force  are  reported  in  Table  4-3.  The  fre¬ 
quency  of  supervisors  in  the  final  sample  ranged  from  1  to  15  in  an  AFSC 
with  a  median  of  11.  14. 


lows: 


Number  of  years  in  an  AFSC  for  supervisors  was  coded  as  fol- 


1. 

Less 

than  1  year  to  1  year. 

2. 

More 

than  1  to  4  years. 

3. 

More 

than  4  to  7  years. 

4. 

More 

than  7  to  10  years. 

5. 

More 

than  10  years. 

The  median  of  coded  number  of  years  (calculated  from  class  intervals 
of  scale  values  and  converting  to  years,  as  indicated  above)  in  an  AFSC 
ranged  from  2.25  (more  than  1  to  4  years)  to  5.00  (more  than  10  years) 
In  25  (71%)  of  the  AFSCs,  the  median  number  of  years  in  an  AFSC  was 
more  than  10  years.  The  modes  of  coded  number  of  years  in  an  AFSC 
ranged  from  2.00  (more  than  1  to  4  years)  to  5.00  (more  than  10  years) 
In  31  (89%)  AFSCs,  the  mode  of  coded  number  of  years  in  an  AFSC  was 
more  than  10  years. 

Number  of  years  in  the  Air  Force  for  supervisors  was  coded  in 
a  manner  identical  with  the  code  for  years  in  an  AFSC.  The  median  of 
coded  number  of  years  in  the  Air  Force  ranged  from  4.00  (more  than 
7  to  10  years)  to  5.  00  (more  than  10  years).  In  33  (94%)  AFSCs,  the 
median  of  coded  number  of  years  in  the  Air  Force  was  more  than  10 
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Table  4-3 


Frequency  of  Supervisors  in  the  Final  Sample  in  35  AFSCs  in 
Four  Aptitude  Areas  with  Median  and  Mode  of  Years  in  their 
Specialty  (AFSC)  and  Years  in  the  Air  Force  (AF)  + 


AFSC 


Mechanical 


Years  in 
AFSC 

n  Hdn  Mo 


Years  in 
AF 

Hdn  Mo 


Munitions  Maintenance 

12 

4.50 

5.00 

5.00 

5.00 

Weapons  Mechanic 

12 

4.64 

5.00 

5.00 

5.00 

Air  Passenger  and  Air  Cargo  Specialist 

2 

4.50 

4. 00; 5. 00 

4.50 

4.00 

Aircraft  Loadmaster 

11 

4.95 

5.00 

5.00 

5.00 

LGM  25  Missile  Mechanic 

13 

2.75 

2.00 

5.00 

5.00 

Vehicle  Operator/Dispatcher 

11 

4.  58 

5.00 

4.81 

5.00 

Fuels  Specialist 

13 

4.96 

5.00 

4.96 

5.00 

Carpentry  and  Masonry  Specialist 

1 

4.00 

4.00 

4.00 

4.00 

Administrative 

Procurement  Specialist 

14 

4.50 

5.00 

5.00 

5.  00 

Chapel  Management 

11 

4.  71 

5.00 

4.95 

5.00 

Legal  Services 

12 

4.00* 

4.  CIO* ;  5. 00* 

5.00* 

5.00’ 

Radio  Operator 

-1 

a. 

5.00 

5.00 

5.00 

5.00 

Personnel 

12 

4.50 

5.00 

5.30 

5.00 

Air  Traffic  Conrroi  Operator  Technician 

10 

4.94 

5.00 

5.00 

5.00 

Airman  Administration 

15 

4.96 

5.00 

4.96 

5.00 

Supply  Services 

10 

4.67 

5.00 

5.00 

5.00 

Airport  Air  Operations 

10 

4.60* 

5.00* 

4.99 

5.00 

General 

Intelligence  Operations  and  imagery  Interpretation 

8 

4.93 

5.00 

4.03 

5.00 

Weather  Forecaster 

10 

4.67 

5.00 

5.30 

5.00 

Information  Specialist 

9 

3.25 

5.00 

5.00 

5.00 

Inventory  Management,  Materiels  Facilities  and 

Supply  Systems 

13 

5.00 

5.00 

5.00 

5.00 

Medical  Services 

10 

4.94 

5.00 

5.00 

5.  00 

Dental  and  Preventive  Dentistry  Technician 

11 

4.89 

5.00 

4.95 

5.00 

Fire  Protection 

11 

4.95 

5.00 

4.95 

5.00 

Graphics 

8 

4.33 

5.00 

5.00 

5.00 

Still  Photographic 

11 

4.89 

5.00 

5.00 

5.00 

Electronics 


Missile  Electronic  Equipment  Specialist 

12 

2.  *2* 

2.00* 

5.30 

5.00 

Missile  Facilities 

12 

2.25 

2.00 

4.95 

5.00 

Aircraft  Electrical  Systems  Specialist 

14 

4.92 

5.00 

4.  32 

5.00 

Avionic  Instrument  Systems  Specialist 

12 

4.95* 

5.00* 

5.00 

5.00 

Ground  Radio  Equipment  Repair 

9 

4.93 

5.  00 

5.00 

5.00 

Electrician 

IL 

4.83 

5.00 

-.95 

5.00 

Electrical  Power  Production 

8 

4 . 83 

5.00 

5.  00 

5.00 

Aircraft  Fuel  Systems  Mechanic 

15 

4.  82 

5.00 

4.96 

5.00 

Jet  Engine  Mechanic 

15 

5.00 

5.00 

5.00 

5.00 

Ln  370 


k0ne  respondeat  did  not  check  a  category  on  the  background  cover  sheet. 

♦Years  in  Air  Force  are  necessarily  more  than  years  in  specialty  for  a  number  of  reasons. 


no 


years.  Similarly  the  modes  of  coded  number  of  years  in  the  Air  Force 
ranged  from  4.  00  to  5.  00.  In  34  (97%)  AFSCs,  the  mode  of  coded  num¬ 
ber  of  years  in  the  Air  Force  was  more  than  10  years. 


Subordinate  Description 


In  the  final  survey,  438  subordinates  (54%  of  the  total  number  of 
participants)  participated.  The  frequency  of  subordinates  in  the  35  AFSCs 
in  the  four  aptitude  areas  together  with  the  median  and  mode  of  coded 
number  of  years  in  an  AFSC  and  the  years  in  the  Air  Force  is  reported 
in  Table  4-4.  The  frequency  of  subordinates  in  the  final  sample  ranged 
from  5  to  20  in  an  AFSC  with  a  median  of  12.  08. 

Number  of  years  in  an  AFSC  for  subordinates  was  coded  in  a 
manner  identical  with  the  code  for  years  in  an  AFSC  for  supervisors. 

The  median  of  coded  number  of  years  in  an  AFSC  ranged  from  1.88 
(more  than  1  to  4  years)  to  4.  50  (more  than  7  to  10  years).  In  11  (31%) 
AFSCs,  the  median  of  coded  number  of  years  in  an  AFSC  was  more  than 
1  to  4  years.  Similarly,  the  modes  of  coded  number  of  years  in  an  AFSC 
ranged  from  2.00  (more  than  1  to  4  years)  to  5.00  (more  than  10  years). 
In  21  (60%)  AFSCs,  the  mode  of  coded  number  of  years  in  an  AFSC  was 
more  than  1  to  4  years. 

Number  of  years  in  the  Air  Force  for  subordinates  was  coded  in 
a  manner  identical  with  the  code  for  years  in  an  AFSC.  The  median  of 
coded  number  of  years  in  the  Air  Force  ranged  from  2.  38  (more  than  1 
to  4  years)  to  4.  50  (more  than  7  to  10  years).  In  23  (67%)  AFSCs,  the 
median  of  coded  number  of  years  in  the  Air  Force  was  more  than  4  to 
7  years.  Similarly,  the  modes  of  coded  number  of  years  in  the  Air 
Force  ranged  from  2.  00  (more  than  1  to  4  years)  to  5.  00  (more  than  10 
years).  In  13  (37%)  AFSCs,  the  mode  of  coded  number  of  years  in  the 
Air  Force  was  more  than  1  to  4  years  and  in  14  (40%)  AFSCs  the  mode 
of  coded  number  of  years  in  the  Air  Force  was  more  than  4  to  7  years. 

Accordingly,  the  number  of  supervisors  and  subordinates  in  the 
final  sample  was  approximately  equal.  But,  as  a  group,  the  supervi¬ 
sors  possessed  more  years  than  the  subordinates  in  an  AFSC  and  in  the 
Air  Force,  as  could  be  expected.  Moreover,  as  a  group,  the  supervi¬ 
sors  were  more  homogeneous  than  the  subordinates  with  respect  to  years 
in  an  AFSC  and  in  the  Air  Force. 

Except  for  Carpentry  and  Masonry  Specialist,  Air  Passenger  and 
Air  Cargo  Specialist,  and  Radio  Operator,  in  24  (69%)  AFSCs  the  discre¬ 
pancy  between  sample  size  of  supervisors  and  subordinates  did  not  ex¬ 
ceed  three  airmen. 


Ill 


Table  4-4 


Frequency  of  Subordinates  in  the  Final  Sample  in  35  AFSCs  in 
Four  Aptitude  Areas  with  Median  and  Mode  of  Years  in  their 
_ Specialty  (AFSC)  and  Years  in  the  Air  Force  (AF)+ _ 

Years  in  Years  In 

AFSC  AF 

AFSC  n  Mdn  Mo  Mdn  Mo 


Mechanical 


Munitions  Maintenance 

14 

2.67* 

2.00* 

2.67* 

2.00* 

Weapons  Mechanic 

15 

2.80 

2.00 

2.83 

2.00 

Air  Passenger  and  Air  Cargo  Specialist 

11 

2.38 

2.00 

2.38 

2 . 00 

Aircraft  Loadmaster 

11 

2.63 

2 . 00 ; 3 . 00 

3.25 

3.00 

LGM  25  Missile  Mechanic 

10 

2.67 

3.00 

3.40* 

3.00* 

Vehicle  Operator/Dispatcher 

12 

4.  50 

5.00 

4.  50 

5.00 

Fuels  Specialist 

13 

3.  71 

4.  00 

3.  71 

4.00 

Carpentry  and  Masonry  Specialist 

20 

2.71* 

2 . 00* ; 3. 00* 

2.83 

3.00 

Administrative 

Procurement  Specialist 

16 

2.50 

2.00;3.00 

3.00 

3. 00 

Chapel  Management 

11 

2 .  o  7 

2.00 

3.00 

.' .  00 

Legal  Services 

U 

1.93 

2.00 

4.17 

5.  30 

Radio  Operator 

13 

3.58 

4.00 

3.58 

4.00 

Personnel 

13 

3.25 

2.00 

3.67 

5.00 

Air  Traffic  Control  Operator  Technician 

17 

2.15 

2.00 

2.75 

2.00 

Airman  Administration 

10 

3.00 

2.00 

3.25 

3.00 

Supply  Services 

11 

3.33 

3.00:5.00 

4.00 

5.00 

Airport  Air  Operations 

5 

1.88 

2.00 

3.75 

4.00 

General 

Intelligence  Operations  and  Imagery  Interpretation 

u 

2.68 

3.00 

3.57 

3.00:5.00 

Weather  Forecaster 

ii 

2.31 

3.00 

2.92 

2.00:3.00:4.00 

Information  Specialist 

12 

2.57 

3.00 

3.00 

3.00 

Inventory  Managements  Materiel  Facilities  and 

Supply  Systems 

15 

3.40 

4.00 

3.75 

4.00 

Medical  Services 

11 

2.92 

3.00 

3.00 

3.00 

Dental  and  Preventive  Dentistry  Technician 

15 

2.86 

3.00 

2.90* 

2. 00*; 3. 00* 

Fire  Protection 

12 

3.  50 

2.00;4.00 

3.  50 

2.00:4.00 

Graphics 

11 

2.40 

2.00 

2 . 80 

3.00 

Still  Photographic 

14 

3.00 

3.00 

3.  50 

5.00 

Elect  ronics 

Missile  Electronic  Equipment  Specialist 

il 

2.S6 

2.00 

2.57 

-.00 

Missile  Facilities 

2.21 

2.00 

3.00 

3. 00 

Aircraft  Electrical  Systems  Specialist 

14 

2.50 

2.00 

2 .  b' 

2.00:3.00 

Avonic  Instrument  Systems  Specialist 

11 

3.08 

3.00 

3.  08 

-.00 

Ground  Radio  Equipment  Repair 

12 

2.  50 

2.00 

2.83 

2.00 

Electrician 

16 

2.50 

2.00 

3.83 

5.00 

Electriclal  Power  Production 

13 

3.00 

2.00 

3. 00* 

2.  GC* 

Aircraft  Fuel  Systems  .Mechanic 

12 

2.50 

2.00 

2.  50 

2.00 

Jet  Engine  Mechanic 

9 

3.00 

3.00 

3.13 

3.00 

Ln  -38 


*One  respondent  did  net  check  a  category  on  the  background  cover  sheet. 

♦Years  in  Air  Force  ate  necessarily  more  than  years  in  specialty  for  a  number  ?;  reasons. 
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Results 


In  the  35  AFSCs,  370  supervisors  and  438  subordinates  judged  the 
amount  of  13  perceptual/ psychomotor  ability  classes  relative  to  the  per¬ 
formance  of  60  tasks  in  their  AFSC,  on  a  seven-point  rating  scale.  Al¬ 
together,  780  judgments  were  made  by  each  airman  in  this  aspect  of  the 
survey. 


Taxonomic  Class  Means  - -Amount 


The  60  judgments  by  a  supervisor  were  summated  for  an  ability 
and  reduced  to  an  arithmetic  mean  for  each  supervisor  in  the  35  AFSCs 
to  generate  an  individual  mean  for  each  supervisor.  Thirteen  sets  of 
individual  means  resulted  for  each  supervisor  in  each  of  the  35  AFSCs. 
(The  total  number  of  individual  means  calculated  was  4,  810).  These 
were  further  reduced  to  a  group  mean  for  the  sampled  supervisors  in 
each  AFSC.  Thirteen  sets  of  group  means  resulted  for  the  supervisors 
in  each  of  the  35  AFSCs.  The  total  number  of  group  means  for  super¬ 
visors  calculated  was  (13  x  35)  455. 

In  a  like  manner  individual  means  and  group  means  of  the  amount 
of  a  perceptual/ psychomotor  ability  by  sampled  subordinates  were  de¬ 
termined.  There  were  5,694  individual  means  and  455  group  means  cal¬ 
culated  for  subordinates. 

Finally,  the  60  judgments  of  amount  of  a  perceptual/  psychomo¬ 
tor  ability  by  all  supervisors  and  all  subordinates  in  an  AFSC  were  sum- 
mated  for  an  ability  and  reduced  to  a  grand  mean  to  generate  a  combined 
mean  for  supervisors  and  subordinates  combined.  The  total  number  of 
such  means  calculated  was  455.  These  means,  combined  for  supervi¬ 
sors  and  subordinates  are  reported  in  Tables  4-5  through  4-8,  accord¬ 
ing  to  the  four  aptitude  areas. 

The  mean  ratings  reported  in  Tables  4-5  through  4-8  generally 
cluster  about  the  low  end  of  the  seven-point  rating  scale.  In  368  out  of 
455  (81%)  of  the  instances,  the  combined  mean  is  below  3.0,  --"some" 
amount  of  the  designated  ability  was  judged  to  be  involved  in  performing 
the  tasks  in  an  AFSC.  This  trend  is  consistent  with  the  pretest  findings. 

In  416  out  of  455  (91%)  comparisons  of  the  group  means  for  sam¬ 
pled  supervisors  and  the  group  means  for  sampled  subordinates  with  re¬ 
spect  to  judgments  of  amount  of  the  13  perceptual/  psychomotor  abilities, 
differences  of  less  than  one  point  on  the  rating  scale  were  found.  Twenty 
out  of  455  (4%)  differences  larger  than  one  point  on  the  rating  scale  clus¬ 
tered  around  visual  memory,  visual  speed  and  accuracy,  and  position 
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Means  and  SDs  of  Judgments  Concerning  Amount  of  13  Perceptual/ Psychomotor 
Abilities  Combined  for  Supervisors  and  Subordinates  in  9  AFSCs  and  in  the  Administrative  Aptitude  Area 


Means  and  SDs  of  Judgments  Concerning  Amount  of  13  Perceptual/ Psychomotor 
Abilities  Combined  for  Supervisors  and  Subordinates  in  9  AFSCs  and  in  the  General  Aptitude  Area 


Means  and  SDs  of  Judgments  Concerning  Amount  of  13  Perceptual/ Psychomotor 
Abilities  Combined  for  Supervisors  and  Subordinates  in  9  AFSCs  and  in  the  Electronics  Aptitude  Area 


Note:  Frequencies  in  parent liesrs  indicate  sample  size  (supervisors  and  subordinates)  In  an  AF$C. 


memory  across  the  35  AFSCs.  The  use  of  combined  means  for  super¬ 
visors  and  subordinates,  instead  of  individual  group  means  was  indicat¬ 
ed  by  the  pretest  results  and  further  supported  by  the  present  data. 

In  51  out  of  52  (98%)  comparisons,  aptitude  area  means  for  each 
ability  separately  differed  from  one  another  by  less  than  one  point  on 
the  rating  scale.  For  48  out  of  52  (92%)  of  the  aptitude  area  means,  the 
obtained  values  were  less  than  2.00. 


Taxonomic  Class  Standard  Deviations- -Amount 

A  standard  deviation  (SD)  was  also  determined  as  a  summary  in¬ 
dex  of  variability/ scatter  of  the  judgments  of  the  amount  of  each  percep¬ 
tual/psychomotor  ability  over  the  60  tasks  in  the  supervisor  and  subor¬ 
dinate  subsamples  separately  in  each  AFSC.  That  is  to  say,  the  60  judg¬ 
ments  by  all  supervisors  in  an  AFSC  were  summated  for  an  ability  and 
reduced  to  an  SD  to  generate  a  group  SD  for  the  sampled  supervisors  in 
an  AFSC.  Thirteen  sets  of  group  SDs  resulted  for  the  supervisors  in 
each  of  the  35  AFSCs.  An  identical  variability  determination  was  made 
for  the  sampled  subordinates  in  each  AFSC.  Thirteen  sets  of  group  SDs 
resulted  for  the  subordinates  in  each  of  the  35  AFSCs.  For  each  sub¬ 
sample,  therefore,  455  group  SDs  were  calculated. 

Finally,  the  60  judgments  of  amount  of  a  perceptual/ psychomo¬ 
tor  ability  by  all  supervisors  and  all  subordinates  in  an  AFSC  were  sum- 
mated  for  each  ability  and  reduced  to  generate  a  SD  combined  for  super¬ 
visors  and  subordinates.  The  total  number  of  such  SDs  calculated  was 
455.  These  SDs  combined  for  sampled  supervisors  and  sampled  subor¬ 
dinates  are  included  in  Tables  4-5  through  4-8  according  to  the  four  ap¬ 
titude  areas. 

As  in  the  pretest,  the  subordinates  in  the  35  AFSCs  were  char¬ 
acteristically  more  variable  than  supervisors  in  their  judgments  of 
amount  of  13  perceptual/psychomotor  abilities  in  the  performance  of  as¬ 
signed  tasks  in  an  AFSC.  Thus,  in  12  out  of  455  (3%)  comparisons  of 
the  group  supervisor  and  group  subordinate  SDs,  subordinates  exceed¬ 
ed  supervisors  by  less  than  one  point  on  the  rating  scale,  in  183  out  of 
455  (40%)  comparisons,  between  one  and  two  points  on  the  rating  scale, 
and,  in  260  (57%)  comparisons,  by  more  than  two  points  on  the  rating 
scale.  It  is  possible  that  this  finding  may  be  due  to  the  heterogeneity 
of  the  backgrounds  of  the  sample  subordinates  in  terms  of  years  in  an 
AFSC  and  in  the  Air  Force,  as  compared  to  the  relative  uniformity  of 
the  backgrounds  of  the  supervisors  on  these  dimensions.  The  subordi¬ 
nates,  as  a  group,  it  could  be  surmised,  may  lack  a  common  frame  of 
reference  or  a  firm  base  for  veridical  judgments.  Ability  and  motiva¬ 
tional  variables,  too,  may  account  for  the  observed  differences. 
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Within  the  administrative,  general,  and  electronics  aptitude  ar¬ 
eas,  all  aptitude  area  SDs  differed  from  one  another  by  less  than  one 
point  on  the  rating  scale;  and,  in  the  mechanical  aptitude  area,  3  out  of 
13  (23%)  aptitude  area  SDs  differed  by  more  than  one-point  on  the  rating 
scale.  Within  the  same  three  aptitude  areas,  23  out  of  39  (59%)  of  the 
aptitude  area  SDs  were  larger  than  2.00,  and  in  the  fourth,  10  out  of  13 
(77%)  of  the  aptitude  area  SDs  were  so. 

"High"  and  "Low"  Ability  Requirements 

The  combined  means  of  judgments  of  the  amount  of  the  13  indi¬ 
vidual  perceptual/  psychomctor  abilities  by  all  sampled  supervisors  and 
subordinates  within  an  AFSC  were  compared  with  the  AFSC  mean  across 
all  abilities.  If  an  individual  mean  deviated  from  the  AFSC  mean  across 
abilities  by  at  least  one  SD  unit  above  the  AFSC  mean,  it  was  inferred 
that  the  sampled  airmen  judged  the  tasks  in  an  AFSC  to  require  a  rela¬ 
tively  "high"  amount  of  the  individual  perceptual/ psychomotor  abilities 
on  the  performance  of  its  tasks.  If  an  ability  mean  deviated  from  the 
across-ability  mean  by  at  least  one  SD  unit  below  the  AFSC  mean,  it 
was  inferred  that  the  sampled  airmen  judged  the  tasks  in  an  AFSC  to  re¬ 
quire  a  relatively  "low"  amount  of  the  individual  ability  on  the  perform¬ 
ance  of  its  tasks.  These  relatively  "high"  and  relatively  "low"  judgments 
of  amount  of  13  perceptual/ psychomotor  abilities  are  reported  for  29 
AFSCs  in  Table  4-9  according  to  the  four  aptitude  areas.  For  six 
AFSCs  no  ability  met  the  plus  or  minus  one  SD  criterion;  Mechanical- - 
Munitions  Maintenance,  Air  Passenger  and  Air  Cargo  Specialist,  Vehi¬ 
cle  Operator/Dispatcher;  Administrative- -Radio  Operator,  and  Gener- 
al--Fire  Protection. 

Distinctive  patterns  of  perceptual/ psychomotor  abilities  emerged 
as  associated  with  the  performance  of  assigned  tasks  in  most  AFSCs. 
Because  of  overlap  of  relatively  "high"  amounts  of  judged  specific  abil¬ 
ities  within  and  between  the  four  aptitude  areas  (like  visual  memory  and 
finger  dexterity  in  each  of  the  four  aptitude  areas  and  clerical  perception 
in  the  administrative  and  general  aptitude  areas  and  position  memory 
both  in  the  mechanical  and  electronics  aptitude  areas)  the  pattern  of  per¬ 
ceptual/psychomotor  abilities  associated  with  the  performance  of  assign¬ 
ed  tasks  assumes  some  importance.  Moreover,  the  patterns  listed  in 
Table  4-9  seem  to  be  in  common  sense  accord  with  actual  job  re¬ 
quirements.  For  example,  visual  memory  and  divided  attention  would 
be  expected  in  an  Air  Traffic  Control  Operator;  finger  dexterity  and 
manual  dexterity  in  a  Dental  and  Preventive  Dentistry  Technician;  fin¬ 
ger  dexterity,  manual  dexterity,  control  precision,  visual  memory, 
visual  speed  and  accuracy,  and  position  memory  in  a  Ground  Radio 
Equipment  Repair  Specialist;  and,  finger  dexterity,  visual  memory, 
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Table  4-9  (cont 


visual  speed  and  accuracy,  and  position  memory  in  a  Weapons  Mechanic. 
Other  examples,  like  Weather  Forecaster,  Personnel  Specialist,  Jet 
Engine  Mechanic,  and  Aircraft  Loadmaster  patterns  of  perceptual/ psy¬ 
chomotor  abilities  support  a  correspondence  between  the  judgments  of 
these  abilities  and  actual  requirements  "on  the  job"  scene.  According¬ 
ly,  a  pattern  of  perceptual/psychomotor  abilities,  taken  with  other  in¬ 
dices  of  cognitive  and  personality  factors,  could  be  decisive  for  person¬ 
nel  assignments. 

With  respect  to  the  relatively  "low"  amounts  of  judged  specific 
perceptual/ psychomotor  abilities  among  the  four  aptitude  areas,  audi¬ 
tory  discrimination  and  auditory  memory  were  consistently  judged  as 
having  "little"  or  "very  little"  involvement  in  task  performance  within 
and  between  AFSCs  in  the  four  aptitude  areas.  Kinesthetic  memory, 
too,  was  generally  minimized  in  the  administrative  and  general  aptitude 
areas- -in  accord  with  logical  expectations.  In  a  similar  fashion,  depth 
perception  cannot  be  expected  in  Legal  Services  and  in  Inventory  Manage¬ 
ment,  Materiel  Facilities,  and  Supply  Systems.  As  for  the  patterns  of 
relatively  "high"  amounts  of  judged  specific  perceptual/ psychomotor 
abilities,  patterns  of  relatively  "low"  amounts  of  judged  abilities  can 
be  useful  in  personnel  classification.  The  "low"  and  "high"  patterns, 
integrated  into  a  unit  for  personnel  classification,  should  improve  the 
probability  of  reducing  the  incidence  of  assigning  to  a  specialty  persons 
with  abilities  not  required  by  that  specialty. 

Across  all  AFSCs,  Table  4-9  indicates  the  four  abilities  most 
required  are:  visual  memory,  visual  speed  and  accuracy,  finger  dex¬ 
terity,  and  manual  dexterity.  The  four  least  required  are:  auditory 
memory,  auditory  discrimination,  kinesthetic  memory,  and  depth  per¬ 
ception. 


Taxonomic  Class  Means--Performance  Quality  Variability 


Each  of  the  airmen  judged  the  performance  quality  variability 
as  a  function  of  the  13  perceptual/psychomotor  abilities  separately  for 
each  of  60  tasks  proper  for  duty  performance  in  their  assigned  AFSC. 
Altogether,  780  judgments  were  made  by  each  airman  during  this 
phase  of  the  survey. 

Individual  means  for  supervisors  and  for  subordinates,  group 
means  for  supervisors  and  subordinates,  as  well  as  combined  means 
for  supervisors  and  subordinates  were  calculated  for  the  60  judgments 
of  performance  quality  variability  as  a  function  of  each  of  the  13  per¬ 
ceptual/  psychomotor  abilities  in  the  35  AFSCs.  As  previously,  there 
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were  5 , 694  individual  means,  455  group  means,  and  455  combined  means. 
The  combined  means  for  alL  sampled  supervisors  and  ajU  sampled  sub¬ 
ordinates  in  an  AFSC  are  presented  in  Tables  4-10  through  4-13  accord¬ 
ing  to  the  four  aptitude  areas. 

Differences  of  Less  than  one  point  on  the  rating  scale  were  found 
in  438  (96%)  comparisons  of  the  group  means  for  supervisors  and  the 
group  means  for  subordinates  with  respect  to  judgments  of  performance 
quality  variability  as  a  function  of  the  13  perceptual/ psychomotor  abili¬ 
ties.  Eleven  (2%)  differences  Larger  than  one  point  on  the  rating  scale 
clustered  around  visual  memory,  visual  speed  and  accuracy,  and  posi¬ 
tion  memory  across  the  35  AFSCs.  The  use  of  combined  means  for  su¬ 
pervisors  and  subordinates,  instead  of  a  mean  for  supervisors  and  a 
mean  for  subordinates  in  Tables  4- 10  through  4-13,  therefore,  was  again 
believed  to  be  supported. 

Group  SDs  and  combined  SDs  for  all  sampled  supervisors  were 
similarly  calculated.  The  combined  SDs  for  all  sampled  supervisors 
and  all  sampled  subordinates  in  an  AFSC  are  reported  in  Tables  4-10 
through  4-13  according  to  the  four  aptitude  areas. 

As  previously,  the  subordinates  in  the  35  AFSCs  were  charac¬ 
teristically  more  variable  than  were  the  supervisors  in  their  judgments 
of  performance  quality  variability  as  a  function  of  the  13  perceptual/psy- 
chomotor  abilities  in  the  performance  of  assigned  tasks  in  an  AFSC.  In 
22  out  of  455  (5%)  comparisons  of  the  group  supervisor  and  group  subor¬ 
dinate  SDs,  subordinates  exceeded  supervisors  by  less  than  one  point 
on  the  rating  scale;  in  299  out  of  455  (66%)  comparisons,  between  one 
and  two  points  on  the  rating  scale;  and  in  134  out  of  455  (29%)  compari¬ 
sons,  by  more  than  two  points  on  the  rating  scale. 

Aptitude  area  means  and  SDs  were  also  computed  for  judgments 
of  performance  quality  variability  as  a  function  of  the  13  perceptual/  psy¬ 
chomotor  abilities  in  the  performance  of  assigned  tasks  in  an  AFSC,  as 
described  for  the  determination  of  aptitude  area  means  and  SDs  for  judg¬ 
ments  of  amount  of  each  ability  in  the  preceding  section.  The  aptitude 
area  means  and  SDs  are  also  reported  in  Tables  4-10  through  4-13. 

In  all  52  (100%)  comparisons,  aptitude  area  means  for  each  abil¬ 
ity  separately  differed  from  one  another  by  less  than  one  point  on  the 
rating  scale.  Thirty -three  out  of  52  (63%)  of  the  aptitude  area  means 
were  less  than  2.00. 

It  was  also  noted  that  all  aptitude  area  performance  quality  var¬ 
iability  SDs  differed  from  one  another  by  less  than  one  point  on  the  rat¬ 
ing  scale.  In  nine  out  of  52  (17%)  comparisons,  the  aptitude  area  SD  was 
larger  than  2.  00. 
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Means  and  SDs  of  Judgments  Concerning  Performance  Quality  Variabilities 
as  a  Function  of  13  Perceptual/ Psychomotor  Abilities  Combined  for 
Supervisors  and  Subordinates  in  8  AFSCs  and  in  the  Mechanical  Aptitude  Area 


Means  and  SDs  of  Judgments  Concerning  Performance  Quality  Variabilities 
as  a  Function  of  13  Perceptual/ Psychomotor  Abilities  Combined  for 
Supervisors  and  Subordinates  in  9  AFSCs  and  in  the  Administrative  Aptitude  Area 


Note:  Frequencies  In  parentheses  Indicate  sample  size  (supervisor*  »m!  siil>orilinntes)  in  an  AFSC. 


Means  and  SDs  of  Judgments  Concerning  Performance  Quality  Variabilities 


Note:  Frequencies  in  parentheses  indicate  sample  size  (supervisors  and  subordinates)  in  an  AFSC. 
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Note:  Frequencies  In  parcntlieae  Indicate  sample  size  (supervisors  and  subordinates)  in  an  AFSC. 
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Within  the  electronics  aptitude  area,  three  out  of  13  (23%)  aptitude 
area  means  differed  from  one  another  by  more  than  one  point  on  the  rat¬ 
ing  scale;  in  each  of  the  general  and  mechanical  aptitude  areas,  four  (31%) 
differed  by  more  than  one  point  on  the  rating  scale;  and,  in  the  adminis¬ 
trative  aptitude  area,  five  out  of  13  (38%)  differed  by  more  than  one  point 
on  the  rating  scale.  For  each  of  the  four  aptitude  areas  overall,  all  ap¬ 
titude  area  SDs  differed  from  one  another  by  less  than  one  point  on  the 
rating  scale. 

"High"  and  "Low"  Performance  Variability  Classes 

The  combined  means  of  judgments  of  performance  quality  varia¬ 
bility  of  each  of  the  13  perceptual/ psychomotor  abilities  by  all  sampled 
supervisors  and  subordinates  within  an  AFSC  were  compared  with  the 
overall  AFSC  mean.  If  an  individual  mean  deviated  from  the  AFSC  mean 
by  at  least  one  SD  unit  above  the  AFSC  mean,  it  was  inferred  that  the 
sampled  airmen  judged  the  performance  quality  variability  as  a  function 
of  the  13  perceptual/ psychomotor  abilities  to  be  relatively  "high"  on  the 
ability.  If  an  individual  mean  deviated  from  the  AFSC  overall  mean  by  at 
least  one  SD  unit  below  the  AFSC  mean,  it  was  inferred  that  the  sampled 
airmen  judged  the  performance  quality  variability  as  a  function  of  the  13 
perceptual/ psychomotor  tasks  to  be  relatively  "low"  in  the  performance 
of  assigned  tasks  within  an  AFSC.  The  relatively  "high"  and  relatively 
"low"  judgments  of  performance  quality  variability  as  a  function  of  the  13 
perceptual/ psychomotor  abilities  are  presented  for  18  AP^SCs  in  Table  4- 
14  by  aptitude  area.  For  the  remaining  AFSCs,  the  plus  or  minus  one 
SD  criterion  was  not  met  by  any  individual  taxonomic  class. 

With  the  exception  of  Radio  Operator  in  Table  4-14,  the  AFSCs 
previously  reported  in  Table  4-9  are  represented  again  in  Table  4-14. 
However,  Table  4-14  includes  11  fewer  AP’SCs  than  does  Table  4-9. 

This  suggests  (a)  some  consistency  in  results  and  (b)  somewhat  less  dis¬ 
criminatory  power  for  the  performance  quality  variability  question.  Where 
an  AFSC  is  common  to  both  tables,  there  is  a  "high"  correspondence  be¬ 
tween  perceptual/ psychomotor  abilities  previously  reported  in  Table  4-9 
and  again  reported  in  Table  4-14,  i.  e. ,  if  an  ability  was  indicated  in  Ta¬ 
ble  4-9,  it  is  highly  probable  that  it  will  be  indicated  again  in  Table  4-14. 
This  correspondence  suggests  a  perceptiveness  of  the  critical  abilities 
required  in  the  performance  of  assigned  tasks  within  an  AFSC.  What¬ 
ever  is  essential  for  successful  execution  of  a  task  can  be  expected  to 
dominate  observational  awareness/alertness.  Individual  differences  in 
efficient  performance,  as  a  rule,  are  readily  communicated  and  quickly 
registered.  Thus,  if  a  "high"  amount  of  a  perceptual/  psychomotor  abil¬ 
ity  is  required  for  the  performance  of  assigned  tasks  within  an  AFSC,  it 
would  follow  that  not  all  personnel  so  engaged  would  be  equally  prol'icienl 
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Table  4-14  (cont 


in  the  performance  of  those  tasks.  Similarly  if  a  "low"  amount  of  a  per¬ 
ceptual/  psychomotor  ability  is  required  for  the  performance  of  assigned 
tasks  within  an  AFSC,  it  would  follow  that  individual  differences  could  be 
expected  to  be  muted  in  the  performance  of  those  tasks. 

The  patterns  of  perceptual/ psychomotor  abilities  emerging  in  Ta¬ 
ble  4-14  complement  the  patterns  of  perceptual/  psychomotor  abilities  al¬ 
ready  reported  inTable4-9.  The  inferences  made  concerning  the  patterns 
in  connection  with  the  judgments  of  the  amount  of  13  perceptual/ psycho¬ 
motor  abilities  can  be  given  an  additional  weight  in  personnel  classifica¬ 
tion  assignments  to  an  aptitude  area.  For,  as  performance  quality  vari¬ 
ability  as  a  function  of  the  13  perceptual/  psychomotor  abilities  increases, 
the  probability  of  objective  achievement  within  an  AFSC  decreases  with 
corresponding  increases  in  cost  of  training  and  retraining.  The  more  ho¬ 
mogeneous  the  work  group  in  terms  of  raw  talent  and  operational  efficien¬ 
cy,  the  more  productive  is  that  work  group  toward  realizing  group  aims. 
Thus,  "high"  performance  quality  variability  as  a  function  of  the  13  per¬ 
ceptual/psychomotor  abilities  signals  a  need  for  reevaluation  of  classifi¬ 
cation  assignments.  "Low"  performance  quality  variability  as  a  function 
of  13  perceptual/ psychomotor  abilities  confirms  that  individual  differ¬ 
ences  in  the  operational  display  of  an  ability  is  not  detrimental  to  the  ef¬ 
forts  of  the  work  group  toward  the  achievement  of  designated  goals. 

Comparison  of  the  grand  means  for  the  previous  amount  data  and 
for  the  performance  qualitv  variability  judgments  indicates  the  same  four 
highest  and  four  lowest  abilities  to  be  involved  in  both  cases. 

Task  Information- -Amount 

The  sampled  airmen  judged  the  amount  of  the  13  perceptual/ psv- 
chomotor  abilities  required  in  the  efficient  performance  of  each  of  60 
tasks,  as  previously  described.  The  judgments  were  reduced  to  a  task 
mean  for  each  task  in  terms  of  the  13  abilities.  Accordingly,  780  (60  x 
13)  task  means  were  calculated  for  each  of  the  35  AFSCs. 

To  ascertain  whether  the  60  tasks  in  an  AFSC  differed  from  one 
another  in  terms  of  the  13  perceptuaL/  psychomotor  abilities  required  in 
the  efficient  performance  of  a  task,  each  task  mean  was  compared  with 
the  combined  mean  for  supervisors  and  subordinates  for  that  ability's 
amount  in  an  AFSC.  If  a  task  mean  was  one -half  SD  above  the  combined 
mean  for  supervisors  and  subordinates  for  an  ability,  that  task  was 
judged  to  require  a  relatively  high  amount  of  the  ability  in  the  efficient 
performance  of  the  task.  If  a  task  mean  was  one-half  SD  below  the  com¬ 
bined  mean  for  supervisors  and  subordinates,  that  task  was  judged  to  re¬ 
quire  a  relatively  low  amount  of  that  ability  in  the  efficient  performance 
of  that  task.  This  procedure  compares  each  task  to  every  other  task  on 
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an  individual  ability  basis.  The  frequencies  of  task  means  deviating  one- 
half  SD  unit  above  (high)  and  below  (low)  the  reported  combined  means 
for  supervisors  and  subordinates  for  each  of  the  13  perceptual/psycho¬ 
motor  abilities  in  each  AFSC  according  to  the  four  aptitude  areas  are  re¬ 
ported  in  Tables  4-15  through  4-18. 

It  can  be  noted,  in  general,  that  2,629  out  of  27,300  (10%)  task 
means  deviated  one-half  SD  unit  above  the  perceptual/ psychomotor  abil¬ 
ity  mean  over  the  35  AFSCs  and  that  1,  772  out  of  27,  300  (6%)  task  means 
deviated  one-half  unit  below  the  perceptual/  psychomotor  ability  means 
over  the  35  AFSCs.  The  two  tasks  in  each  ability  which  were  highest 
are  identified  in  Table  4-19. 

Aptitude  areas  differed  from  one  another  in  terms  of  the  frequen¬ 
cy  of  relatively  "high"  and  "low"  tasks  identified  for  each  of  the  13  abil¬ 
ities.  In  the  administrative  aptitude  area,  only  468  out  of  7,020  (7%) 
task  means  deviated  one-half  SD  unit  above  the  selected  criterion  means 
and  297  out  of  7,020  (4%)  task  means  deviated  below  the  selected  crite¬ 
rion  means.  In  the  mechanical  aptitude  area,  732  out  of  6,240  (12%) 
task  means  deviated  above  the  selected  criterion  means  and  508  (8%) 
task  means  deviated  below  the  selected  criterion  means.  Similarly,  in 
the  electronics  aptitude  area,  7  84  out  of  7,020  (11%)  task  means  devi¬ 
ated  above  the  selected  criterion  means  and  599  out  of  7,020  (9%)  task 
means  deviated  below  the  selected  criterion  means.  In  the  general  ap¬ 
titude  area,  644  out  of  7,020  (9%)  task  means  deviated  above  and  368  (5%) 
task  means  deviated  below  the  selected  criterion  means.  Sampled  air¬ 
men  in  the  four  aptitude  areas,  therefore,  expressed  differential  judg¬ 
ments  concerning  the  amount  of  the  13  perceptual/ psychomotor  abilities 
required  in  the  efficient  performance  of  the  60  tasks  in  an  aptitude  area. 
It  can  be  surmised  that  enlisted  personnel  are  sensitive  to  the  require¬ 
ments  of  efficient  job  performance  and  that  different  aptitude  areas  are 
distinguished  by  different  patterns  of  perceptual/ psychomotor  abilities 
for  the  efficient  performance  of  assigned  tasks. 

Moreover,  scrutiny  of  each  AFSC  confirms  the  emergence  of  dif¬ 
ferential  patterns  of  "high"  and  "low"  deviating  task  means  with  respect 
to  the  13  perceptual/ psychomotor  abilities.  It  is  clear  from  Tables  4- 
15  through  4-18  that  different  tasks,  as  would  be  expected,  require  dif¬ 
ferent  amounts  of  a  perceptual/  psychomotor  ability. 

The  relative  significance  of  a  perceptual/ psychomotor  ability  in 
the  efficient  performance  of  the  tasks  of  an  AFSC  can  be  abstracted  from 
Tables  4-15  through  4-18.  Thus,  for  example,  "high"  and  "low"  devi¬ 
ations  occur  very  frequently  in  connection  with  finger  dexterity,  manual 
dexterity,  and  control  precision  but  considerably  less  frequently  in  con¬ 
nection  with  rate  control,  depth  perception,  divided  attention,  and  kin¬ 
esthetic  memun.  Weights,  therefore,  could  be  assigned  to  AFSC  tasks 


Frequency  of  Means  of  Judgments  of  Tasks  Relative  to  Amount 
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Table  4-19 


Ability 

Finger 

Dexterity 


Manual 

Dexterity 


Control 

Precision 


Rate 

Control 


Visual 

Memory 


Visual 
Speed  & 
Accuracy 

Position 

Memory 


Auditory 

Discrim¬ 

ination 


Two  Tasks  Which  Were  Highest  on  Each 
Perceptual/  Psychomotor  Ability 


Task  (Mean  Rating*.  Specialty) 

Draw  symbols,  emblems  or  pictures  on  graphics  or  masters 
(6.53*,  Graphics) 

Letter  graphics  products  such  as  charts,  posters,  or 
certificates  using  freehand  pen  techniques  (6.44,  Graphics) 

Solder,  splice  or  replace  wiring  or  connectors  in 
instrument  systems  (6.00,  Avionics  Instrument  Systems) 
Assemble  or  wire  radio  or  auxiliary  equipment  components 
for  installation  (6.10,  Ground  Radio  Equipment  Repair) 

Operate  standard  gasoline  or  electric  powered  forklifts 
(6.23,  Munitions  Maintenance) 

Operate  munitions  transport  trucks  or  truck-tractors 
(6.19,  Munitions  Maintenance) 

Operate  standard  gasoline  or  electric  powered  forklifts 
(6.08,  Munitions  Maintenance) 

Operate  munitions  transport  trucks  or  truck-tractors 
(6.00,  Munitions  Maintenance) 

Calibrate  or  adjust  heads-up  display  (6.33  Avionics 
Instrument  Systems) 

Compare  climatological  factors  with  weather  systems 
(5.89,  Weather  Forecaster) 

Remove  and  inspect  engine  bearings  (6.13,  Jet  Engine 
Mechanic) 

Locate  meteorological  features  on  charts  (5.90,  Weather 
Forecaster) 

Perform  preflight  or  postflight  inspections  on  static 
discharges  (6.00,  Radio  Operator) 

Prepare  aircraft  for  engine  removal  or  installation 
(5.96,  Jet  Engine  Mechanic) 

Operate  rotating  antenna  equipment  for  maximum  signal 
strength  (6.13,  Radio  Operator) 

Make  receiver  changes  or  adjustments  to  reduce  inter¬ 
ference  (6.13,  Radio  Operator) 


137 


Table  4-19  (cont. ) 


Auditory 

Memory 


Clerical 

Perception 


Depth 

Perception 


Divided 

Attention 


Kinesthetic 

Memory 


Report  interference  caused  by  jamming  (5.87,  Radio 
Operator) 

Determine  type  of  interference  (5.53,  Radio  Operator) 

Perform  graphical  or  statistical  analysis  of  technical 
studies  (6.13,  Weather  Forecaster) 

Perform  pure  system  analysis  (5.89,  Weather  Forecaster) 

Establish  landing  sequences  (5.70,  Air  Traffic  Control 
Operator) 

Hold  arriving  VFR  aircraft  at  visual  fixes  (5.19,  Air 
Traffic  Control  Operator) 

Establish  landing  sequences  (6.26,  Air  Traffic  Control 
Operator) 

Test  personnel  under  operational  conditions  (6.11,  Air 
Traffic  Control  Operator) 

Load  film  onto  reels  (4.92,  Still  Photographic) 

Remove  and  install  components  within  fuel  cells  (4.70, 
Aircraft  Fuel  Systems  Mechanic) 
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in  terms  of  the  amount  of  the  ability  judged  to  be  required  for  efficient 
performance  of  those  tasks.  That  is  to  say,  perceptual/ psychomotor 
abilities  vary  in  their  contributions  to  job  efficiency;  attention  needs  to 
be  focused  on  some  abilities  and  withdrawn  from  others. 


To  ascertain  whether  the  60  tasks  in  an  AFSC  differed  from  one 
another  in  terms  of  performance  quality  variability  as  a  function  of  the 
13  perceptual/ psychomotor  abilities,  each  task  mean  was  compared  with 
the  combined  mean  for  supervisors  and  subordinates.  Accordingly,  780 
comparisons  were  made  in  each  AFSC  separately.  If  a  task  mean  was 
one-half  SD  unit  above  the  ability,  that  task  was  judged  to  display  a  rel¬ 
atively  "high"  performance  quality  variability  as  a  function  of  the  13  per¬ 
ceptual/psychomotor  abilities.  If  a  task  mean  was  one-half  SD  unit  be¬ 
low  the  ability  mean,  that  task  was  judged  to  display  a  relatively  low  per¬ 
formance  quality  variability.  The  frequencies  of  task  means  deviating 
one -half  SD  unit  above  (high)  and  below  (low)  the  combined  means  are 
reported  in  Tables  4-20  through  4-23. 

Of  the  total,  1,261  (4.6%)  task  means  deviated  one-half  SD  unit 
above  the  ability  mean  combined  for  supervisors  and  subordinates  with 
respect  to  performance  quality  variability  and  635  (2%)  task  means  de¬ 
viated  one -half  SD  unit  below  the  ability  mean  with  respect  to  perform¬ 
ance  quality  variability.  On  the  general  level,  these  data  suggest  that 
performance  quality  variability  as  a  function  of  the  13  perceptual/ psy¬ 
chomotor  abilities  was  not  perceived  as  being  a  significant  variable  in 
assessing  job  efficiency.  In  general,  the  findings  suggest  that  the  sam¬ 
ple  airmen  believed  efficient  performance  of  assigned  tasks  in  their  re¬ 
spective  AFSCs  to  be  fairly  uniform  as  a  function  of  the  abilities  con¬ 
sidered. 

More  specifically,  the  four  aptitude  areas  did  not  differ  from  one 
another  appreciably  in  terms  of  the  frequency  of  relatively  "high"  and 
"low"  tasks  identified  for  each  of  the  13  abilities.  In  each  of  the  four 
aptitude  areas,  approximately  1  percent  of  the  task  means  deviated  one- 
halt  SD  unit  above  the  selected  criterion  mean.  In  the  mechanical  and 
the  electronics  aptitude  areas,  approximately  1  pert  ent  of  the  task 
means  deviated  one-half  unit  below  the  selected  criterion  mean,  and 
less  than  1  percent  so  deviated  in  both  the  administrative  and  the  gen¬ 
eral  aptitude  areas. 

The  relative  significance  of  the  perceptual/ psychomotor  analysis 
relative  to  performance  quality  variability  can  be  abstracted  from  Tables 
4-20  through  4-23.  Frequencies  of  such  deviations  also  varied  only 
slightly  between  and  within  AFSC's. 


Task  Information--Performance  Quality  Variabilitv 


Table  4-20 


of  Judgments  of  Tasks  Relative  to  Performance  Quality  Variability 


Means  of  Judgments  of  Tasks  Relative  to  Performance  Quality  Variability 
as  a  Function  of  13  Perceptual/ Psychomotor  Abilities  One -Half  SD  Unit 


(Tables  4-20 
UirmiRh  4-25) 


Agreement  Between  Amount  and  Performance 


As  noted  earlier,  the  amount  ol'  13  perceptual/ psychomotor  abil¬ 
ities  in  the  efficient  performance  of  60  tasks  was  judged  by  supervisors 
and  subordinates.  Similarly,  supervisors  and  subordinates  judged  per¬ 
formance  quality  variability  as  a  function  of  the  13  abilities.  The  two 
series  of  perceptual/ psychomotor  ability  means  allow  for  a  direct  com¬ 
parison.  Accordingly,  the  two  sets  of  means  were  separately  ranked 
from  low  to  high  by  AFSC.  These  rankings  were  separately  graphed  in 
Figures  4-1  and  4-2  along  with  the  boundaries  of  one-half  SD  unit  above 
and  below  the  mean. 

The  lowest  and  the  highest  five  ranked  ability  amount  means  were 
compared  with  the  lowest  and  the  highest  five  ranked  performance  qual¬ 
ity  variability  means,  respectively.  It  was  merely  sufficient  that,  with¬ 
in  an  AFSC,  the  mean  of  a  perceptual/ psychomotor  ability  appeared  in 
the  appropriate  set  without  regard  to  hierarchical  position  within  the  set. 
The  frequency  of  matches  within  the  "low"  and  "high"  sets  was  reduced 
to  a  percentage.  The  percentage  was  designated  as  a  percentage  agree¬ 
ment  index.  The  percentage  agreement  indices  are  reported  in  Table 
4-24  acc  ording  to  the  four  aptitude  areas. 

it  can  be  immediately  noted  that  30  out  of  35  (36To)  of  the  per¬ 
centage  agreement  indices  are  90  and  100.  Idle  lowest  index  was  obtain¬ 
ed  for  Radio  Operator.  These  data  suggest  that  correspondence  exists 
between  the  amount  of  a  skill  required  in  efficient  performance  of  a  task 
and  the  perceived  performance  quality  variability  associated  with  such 
performance,  if  it  can  be  assumed  that  increases  in  the  amount  of  an 
ability  required  for  efficient  performance  can  be  construed  to  mean  in¬ 
creased  criticality  for  task  performance,  then  it  follows  that  sensitivity 
to  individual  difference  in  efficient  performance  could  be  expected  to  co¬ 
vary  with  that  critical  level.  The  higher  the  percentage  agreement  in¬ 
dex,  the  more  closely  related  would  be  the  amount  of  skill  and  perform¬ 
ance  quality  variability,  i.  e.  ,  one  could  not  prudently  be  dissociated 
from  the  other. 

Moreover,  the  slopes  of  the  comparable  sets  of  curves  parallel 
each  other  elosely.  The  frequencies  of  both  sets  of  ranked  means  are 
reported  in  Table  4-25.  Thus,  rate  eontrol,  auditory  discrimination, 
auditory  memory,  and  kinesthetic  memory  characteristically  were  a* 
mong  the  lowest  five  ranked  means  in  the  two  series  of  judgments. 
Finger  dexterit  \ ,  manual  dexterity  ,  visual  memory,  visual  speed  and 
accuracy,  and  position  memory  characteristically  were  among  'he  Inch¬ 
est  five  ranked  means  m  the  two  s»  ries  of  judgments.  Ao  ending!  \  ,  the 
relative  importance  of  these  skills  is  further  established  m  the  cffi<  u  ir 
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FD  -  Finger  Dexterity  PM  =  Position  Memory 

AD  =  Auditory  Discrimination  MD  =  Manual  Dexterity 

CP  -  Control  Precision  AM  =  Auditory  Memory 

RC  =  Rate  Control  DP  =  Depth  Perception 

VM  =  Visual  Memory  DA  =  Divided  Attention 

VSA  =  Visual  Speed  and  Accuracy  KM  =  Kinesthetic  Memory 

CLP  =  Clerical  Perception 

Figure  4  1.  Mean  and  +  .5  standard  deviation  for  each  ability 
for  judgment  of  amount. 
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Figm«  4-»  Continued 


Figure  4-1  Continued 


148 


Figure  4-1.  Continued. 
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Figure  4-2.  Mean  and  +  .5  standard  deviation  for  each  ability 
for  judgments  of  quality  and  variability. 
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Table  4-24 


Agreement  Indices  Between  Means  of  Judgments  of  Amount 


AFSC 

Agreement 

AFSC 

Agreement 

Mechanical 

Munitions  Maintenance 

100 

Weather  Forecaster 

100 

Weapons  Mechanic 

Air  Passenger  and  Air 

100 

Information  Specialist 
Inventory  Management, 

90 

Cargo  Specialist 

80 

Materiel  Facilities 

Aircraft  Loadmaster 

90 

and  Supply  Systems 

90 

LGM  25  Missile  Mechanic 

Vehicle  Operator/ 

90 

Medical  Services 

Dental  and  Preventive 

90 

Dispatcher 

100 

Denistry  Technician 

90 

Fuels  Specialist 

100 

Fire  Protection 

90 

Carpentry  and  Masonry 

Graphics 

80 

Specialist 

Administrative 

90 

Still  Photographic 

Elect  ronics 

100 

Procurement  Specialist 

100 

Missile  Electronic 

Chapel  Management 

100 

Equipment  Specialist 

100 

Legal  Services 

90 

Missile  Facilities 

80 

Radio  Operator 

60 

Aircraft  Electrical  Systems 

Personnel 

Air  Traffic  Control 

100 

Specialist 

Avionic  Instrument  Systems 

90 

Operator  Technician 

90 

Specialist 

90 

Airman  Administration 

90 

Ground  Radio  Equipment 
Repair 

80 

Supply  Services 

100 

Electrician 

90 

Airport  Air  Operations 

General 

100 

Electrical  Power 

Production 

Aircraft  Fuel  Systems 

90 

Mechanic 

100 

Intelligence  Operations 
and  Imagery  Interpre¬ 
tation 

90 

Jet  Engine  Mechanic 

90 
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Table  4-25 


Frequency  of  Occurrence  of  Ability  Means  for  Amount 
and  of  Performance  Quality  Variability 
_ in  High  and  Low  Categories _ 


Amount  Quality 


Ability 

Low 

High 

Low 

High 

Finger  Dexterity 

- 

31 

1 

31 

Manual  Dexterity 

2 

29 

1 

28 

Control  Precision 

3 

2 

7 

4 

Rate  Control 

23 

1 

23 

- 

Visual  Memory 

- 

35 

- 

33 

Visual  Speed  and  Accuracy 

- 

32 

- 

30 

Precision  Memory 

- 

28 

- 

32 

Auditory  Discrimination 

31 

1 

32 

- 

Auditory  Memory 

32 

- 

34 

- 

Clerical  Perception 

7 

9 

6 

9 

Depth  Perception 

26 

1 

29 

1 

Divided  Attention 

13 

4 

14 

3 

Kinesthetic  Memory 

27 

- 

28 

1 
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performance  of  assigned  AFSC  tasks.  It  could  be  that  these  skills  are 
more  or  less  necessary  for  effective  duty  performance  and  should  be 
seriously  attended  to  in  career  assignments. 

Pearson  coefficients  of  correlation  were  also  computed  between 
ability  means  and  the  performance  quality  variability  means  across  the 
35  AFSCs.  The  correlation  coefficient  for  each  AFSC  is  reported  in 
Table  4-26  according  to  the  four  aptitude  areas. 

It  can  be  immediately  noted  that  32  (91%)  of  the  obtained  coeffi¬ 
cients  exceed  .900.  The  lowest  correlation  was  obtained  for  Radio  Op¬ 
erator.  The  correlation  coefficients  for  Air  Passenger  and  Air  Cargo 
Specialist  and  for  Ground  Radio  Equipment  Repairman  were  .794  and 
.  820,  respectively.  The  median  correlation  coefficient  was  .971.  A 
high  correspondence  was  again  demonstrated,  therefore,  between  the 
ability  means  and  performance  quality  variability  means.  For  all  prac¬ 
tical  purposes,  the  two  series  of  judgments  were  communicating  essen¬ 
tially  the  same  information  concerning  the  role  of  the  13  perceptual/ psy¬ 
chomotor  abilities  in  the  efficient  performance  of  the  tasks  of  an  AFSC. 
Differential  perceptions  concerning  the  amount  of  a  skill  and  perform¬ 
ance  quality  covaried,  as  a  rule.  Common  factors  seemed  to  have  been 
operating  in  influencing  the  sampled  airmen  in  rendering  the  two  series 
of  judgments. 

Supervisor -Subordinate  Agreement 

Product  moment  correlation  coefficients  were  calculated  between 
the  mean  data  for  both  the  amount  and  performance  quality  variability 
ratings  made  by  the  supervisors  and  the  subordinates  within  each  career 
field.  The  resulting  correlation  coefficients  are  presented  in  Table  4-27. 

With  the  exception  of  two  AFSCs  (Air  Passenger  and  Cargo  Spe¬ 
cialist  and  Radio  Operator),  the  correlation  between  supervisors  and 
subordinates  was  very  high.  An  examination  of  the  individual  judgments 
for  the  two  career  fields  with  low  supervisor -subordinate  correlations 
revealed  that  two  supervisors  in  each  group  were  divergent  from  the 
others.  The  effects  of  the  two  divergent  sets  of  judgments  were  power¬ 
ful  enough,  with  the  relative  sample  sizes,  to  depress  the  resultant  cor¬ 
relation  coefficients. 

The  correlations  for  the  career  fields,  in  Table  4-27,  were  con¬ 
verted  to  z'  coefficients  and  averaged.  The  average  correlations,  across 
the  35  career  fields,  were  .94  for  amount  judgments  and  .90  for  per¬ 
formance  quality  judgments,  it  is  apparent  from  correlations  as  high 
as  those  obtained  that  supervisors  and  subordinates,  within  a  given 


Table  4-26 


Correlation  (r)  Between  Amount  of  13  Perceptual/  Psychomotor 
Skills  and  Judgments  of  Performance  Quality  Variability 


AFSC 

_r 

AFSC 

_r 

Mechanical 

Munitions  Maintenance 

0.978 

Weather  Forecaster 

0.992 

Weapons  Mechanic 

0.974 

Information  Specialist 

0.972 

Air  Passenger  and  Air 

Inventory  Management, 

Cargo  Specialist 

0.794 

Materiel  Facilities 

Aircraft  Loadmaster 

0.946 

and  Supply  Systems 

0.985 

LGM  25  Missile  Mechanic 

0.968 

Medical  Services 

0.954 

Vehicle  Operator/ 

Dental  and  Preventive 

Dispatcher 

0.949 

Dentistry  Technician 

0.980 

Fuels  Specialist 

0.983 

Fire  Protection 

0.974 

Carpentry  and  Masonry 

Graphics 

0.987 

Specialist 

0.967 

Still  Photographic 

0.986 

Administrative 

Electronics 

Procurement  Specialist 

0.993 

Missile  Electronic 

Chapel  Management 

0.953 

Equipment  Specialist 

0.959 

Legal  Services 

0.994 

Missile  Facilities 

0.931 

Radio  Operator 

0.680 

Aircraft  Electrical 

Personnel 

0.993 

Systems  Specialist 

0.953 

Air  Traffic  Control 

Avionic  Instrument 

Operator  Technician 

0.976 

Systems  Specialist 

0.930 

Airman  Administration 

0.960 

Ground  Radio  Equipment 

Supply  Services 

0.963 

Repair 

0.820 

Airport  Air  Operations 

0.959 

Electrician 

0.971 

Electrical  Power 

Production 

0.970 

General 

Aircraft  Fuel  Systems 

Mechanic 

0.975 

Intelligence  Operations 

Jet  Engine  Mechanic 

0.975 

and  Imagery  Interpre¬ 

tation 

0.989 
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Table  4-27 


Correlation  Between  Supervisor  and  Subordinate  Ratings  for 
Amount  (A)  and  Performance  Quality  Variability  (PQV)  Judgments 


Correlation 

AFSC  A  PQV 


Mechanical 


Munitions  Maintenance 

.94 

.90 

Weapons  Mechanic 

.93 

.88 

Air  Passenger  and  Air  Cargo  Specialist 

.29 

.  76 

Aircraft  Loadmascer 

.93 

.  39 

LGM  25  Missile  Mechanic 

.93 

.  91 

Vehicle  Operator /Dispatcher 

.95 

.  76 

Fuels  Specialist 

.95 

.37 

2  iroentry  and  Masonry  Specialist 

.35 

.35 

Administrative 


Procurement  Specialist 
Chapel  Management 
Legal  Services 
Radio  Operator 
Personnel 

Air  Traffic  Control  Operator  Technician 
Airman  Administration 
Supply  Services 
Airport  Air  Operations 


.97  .98 
.98  .96 
.94  .92 
.63  .50 
.95  .94 
.39  .92 
.97  .92 
.32  .77 
.S4  .70 


General 


Intelligence  Operations  and  Imagery  Interpretation 

.95 

.97 

Weather  Forecaster 

.97 

.95 

Information  Specialist 

.90 

.  77 

Inventory  Management  Materiel  Facilities  and  Supply  Systems 

.94 

.97 

Medical  Services 

.90 

.32 

Dental  and  Preventive  Dentistry  Technician 

.89 

.36 

Fire  Protection 

.96 

.  82 

Graphics 

.96 

.91 

Still  Photographic 

.  96 

.98 

Electronics 


Missile  Electronic  Equipment  Soecialist 

.94 

.35 

Missile  Facilities 

.  97 

.33 

Aircraft  Electrical  Systems  Specialist 

.91 

.33 

Avionic  Instrument  Systems  Specialist 

.99 

.95 

Ground  Radio  Equipment  Repair 

.  33 

.  86 

Elect rician 

.94 

.  17 

Electrical  Power  Production 

.  96 

.  94 

Aircraft  Fuel  Systems  Mechanic 

.  93 

.96 

Jet  Engine  Me  .hanic 

.  9*» 

.  76 

Average 

.94 

.90 
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career  field,  may  be  regarded  as  representative  of  a  single  Air  Force 
population  of  job  incumbents  for  the  purpose  of  job  analytic  judgments 
such  as  those  made  in  the  present  survey. 


Profile  Similarity 


An  index  of  profile  similarity  was  computed  to  compare  the  pro¬ 
files  of  the  35  AFSCs,  The  amount  and  the  performance  quality  vari¬ 
ability  profiles  were  considered  separately.  The  index  of  profile  sim¬ 
ilarity  employed  was  the  D  statistic  (Osgood  and  Suci,  1952).  The  equa¬ 
tion  for  computing  the  D  statistic  is: 


D  =  /zd2 


where: 


d  =  difference  between  the  score  on  an  ability 
for  one  specialty  and  the  score  on  the 
same  ability  for  another  specialty. 

The  equation  considers  both  the  shape  and  the  elevation  of  the 
profiles  compared  and  is  superior  to  the  product  moment  correlation 
in  this  regard  because  the  product  moment  correlation  considers  only 
shape.  The  D  statistic  was  computed  among  all  AFSCs  (35  x  34/2)  for 
amount  and  for  performance  quality  variability.  The  profiles  were  cat¬ 
egorized  as  essentially  similar  or  essentially  dissimilar.  The  essen¬ 
tially  similar  criterion  was  aD  score  of  2.52  (10%)  of  the  maximum 
range  of  the  D  statistic  or  less.  The  percentage  of  the  specialties  which 
met  the  "essentially  similar  with  the  other  AFSCs  criterion"  was  com¬ 
puted.  The  results  are  shown  in  Table  4-28.  For  amount,  the  Weather 
Forecaster  AFSC  never  met  the  criterion  and  the  Medical  Services  Spe¬ 
cialist  AFSC  met  the  criterion  for  76  percent  of  the  comparisons.  Ac¬ 
cordingly,  the  Weather  Forecaster  AFSC  is  more  independent  than  the 
Medical  Services  Specialist  AFSC.  The  median  percentage  in  Table  4- 
28  is  50  for  amount  and  65  for  performance  quality  variability.  There 
-  Mime  evidence  for  partial,  but  not  high,  independency  among  the 

.  r  m  s. 


■  relations  Among  Abilities  and  Factor  Analysis- -Amount 

•  •  u-  an  ratings  of  the  amount,  of  each  ability  (across  60  tasks) 
.  i  m  were  intercorrelated  to  yield  a  13  by  13  matrix.  The 
.  x  of  intercorrelations  is  shown  in  Table  4-29.  A  sum- 
:  ..  i  moment  correlation  coefficients  follows: 
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Table  4-28 


Percentage  of  D  Scores  in  Each  AFSC 
Within  10  Percent  of  the  D  Range  (2.52)  or  Less 


Specialty  Amount  % 


Aircraft  Loadmaster  68 
Intelligence  Operations  and  Imagery  Interpretation  41 
Graphics  35 
Still  Photographic  65 
Weather  Forecaster  0 
Airport  Air  Operations  18 
Air  Traffic  Control  Operator  Technician  0 
Radio  Operator  6 
Ground  Radio  Equipment  Repair  50 
Missile  Electronic  Equipment  Specialist  59 
Avionic  Instrument  Systems  Specialist  9 
Aircraft  Electrical  Systems  Specialist  32 
Aircraft  Fuel  Systems  Mechanic  62 
Jet  Engine  Mechanic  59 
LGM  25  Missile  Mechanic  53 
Munitions  Maintenance  65 
Weapons  Mechanic  32 
Missile  Facilities  53 
Electrician  53 
Electrical  Power  Production  50 
Carpentry  and  Mascnry  Specialist  53 
Fire  Protection  38 
Vehicle  Operator/Dispatcher  32 
Air  Passenger  and  Air  Cargo  Specialist  32 
Supply  Services  68 
Fuels  Specialist  56 
Inventory  Management,  Materiel  Facilities  and 

Supply  Systems  38 
Procurement  Specialist  18 
Chapel  Management  53 
Airman  Administration  53 
Legal  Services  26 
Personnel  18 
Information  Specialist  38 
Medical  Services  76 
Dental  and  Preventive  Dentistry  Technician  59 


*  PQV  =  Performance  Quality  Variability 


PQV  7.  * 

82 

44 

62 

76 

0 

29 

24 

65 

62 

74 

35 

26 

76 

79 

62 

79 

65 

68 

68 

65 

59 

26 

41 

18 

74 

76 

56 

29 

74 

74 

59 

56 

68 

85 

71 
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Table  4-29 


1.00 


N 


% 


2r.  50< 

.  99 

35 

45 

>.30< 

.49 

20 

26 

>.  10  < 

.29 

9 

12 

<.  io 

14 

18 

These  data  suggest  that  a  moderate  degree  of  uniqueness  exists 
among  the  ratings  of  the  pereeptuai/psychomotor  abilities  for  Air  Force 
job  tasks. 

The  intercorrelation  matrix  was  factor  analyzed  by  the  principal 
components  method  with  orthogonal  rotation  employing  the  SPSS  PA2 
package  (Nie  et  al,  1975).  Three  factors  emerged  employing  the  eigen¬ 
value  of  1.00  or  greater  as  the  criterion  for  accepting  a  factor.  The 
eigenvalues  and  respective  cumulative  proportion  of  variance  were: 

Cumulative  % 

Eigenvalue  of  Variance 


Factor  I 

6.  71 

51.6 

Factor  11 

2.  33 

69. 5 

Factor  111 

1.  86 

83.  8 

The  two  abilities  loading  highest  on  each  factor  along  with  the 
respective  loadings  were; 


Abilities  Loading 
_ Highest _  Loading 

Factor  1  Auditory  Discrimination  .96 

Auditory  Memory  .  93 

Factor  II  Visual  Speed  and  Accuracy  .86 

Visual  Memory  .85 

Factor-  Ill  Manual  Dexterity  .  92 

Finger  Dexterity  .  69 


Attempts  to  disturb  this  solution  through  oblique  rather  than  or¬ 
thogonal  rotation  produced  no  marked  effect.  The  results  of  the  factor 
analysis  suggest,  as  was  probably  to  be  anticipated,  a  visual  factor,  an 
auditory  factor,  and  a  manual  factor. 
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It  is  well  known  that  the  reliability  oi'  ratings  can  be  increased  it 
multiple  judges'  ratings  are  averaged  to  yield  a  single  measure.  By 
pooling  different  judges'  ratings  into  a  eomposite  measure,  the  relia¬ 
bility  canbe  increased  substantially ,  even  with  only  a  moderate  increase 
in  the  number  of  judges.  This  point  has  been  made  explicit  by  Winer 
(1962)  and  by  Cronbaeh,  Gleser,  Nanda,  and  Rajaratnam  (1972).  Re¬ 
cently,  it  has  also  beendemonstrated  that  the  averaged  ratings  of  more 
judges  are  in  fact  more  valid  (Horowitz,  Inouye,  and  Siegelman,  1979). 
Other  things  being  equal,  a  measure  that  is  less  reliable  cannot  corre¬ 
late  as  highly  with  an  external  criterion.  As  one  increases  the  reliabil¬ 
ity  of  a  judgment  by  averaging  the  ratings  of  an  increasing  number  of 
judges,  one  can  expect  the  resulting  measure  to  correlate  more  highly 
with  an  external  criterion. 


For  four  of  theAFSCs(one  randomly  selected  from  each  aptitude 
area),  the  data  of  eight  randomly  selected  supervisors  and  eight  ran¬ 
domly  selected  subordinates  were  analyzed  to  determine  interrater  re¬ 
liability.  The  analyses  included  four  abilities  and  15  tasks.  Eight  sep¬ 
arate  variance  analyses  were  completed- -four  for  subordinates  and  four 
for  supei'visory  raters.  Only  amount  data  were  considered.  Table  4- 
30  presents  the  variance  analytic  model  employed  for  each  of  the  eight 
analyses.  If  an  analysis  of  variance  is  performed  employing  the  model 
presented  as  Table  4-30,  then  the  reliability  of  a  single  judge  may  be 
estimated  by  formula  1.  From  Winer  (1962),  the  formula  is  adapted  as 
follows; 

_  MS  between  treatments  -  MS  error _ 

^  MS  between  treatments  +  (n- 1)  MS  error  (1) 


where;  number  of  raters  (judges)  =  3 

treatments  =  4  abilities,  15  tasks  -  60 


To  provide  appropriate  values  for  the  formula,  bet ween-treat meuts  var¬ 
iance  was  estimated  by  pooling  across  abilities,  tasks,  and  the  tasks- 
by-ability  interaction  (df=  59).  Error  variance  was  estimated  b\  the  in¬ 
teraction  involving  raters  by  tasks  by  abilities  (df=  294).  By  application 
of  the  Spearman-Brown  prediction  formula,  the  reliability  of  any  numbei 
of  judges  may  also  be  estimated.  For  24  judges  the. estimate  is  given  b\ 
formula  2. 

1 (24)  = 

where  r^j  -  reliability  of  a  single  judge 


24(r(p) _ 

1  +  (24  -  1)  (r(  l )) 


Table  4-30 


ANOVA  Model  for  Reliability  Determination 


Source  of  Variation _  _ _ df 


Rater  (S) 

(n-1 ) 

= 

7 

Task  (A) 

(P-1) 

= 

14 

Ability  (B) 

(q-D 

= 

3 

S  x  A 

(n-1) (p— 1 ) 

- 

98 

S  x  B 

(n-l)(q-l) 

- 

21 

A  x  B 

(P-D(q-I) 

= 

42 

S  x  A  x  B 

(n-1)  (p-1)  (q-1) 

= 

294 

TOTAL 


npq-1 


479 


1G7 


Table  4-31  presents  reliability  estimates  for  a  single  judge  (lj), 
the  average  of  eight  judges  (rg),  16  judges  (rig),  and  24  judges  (1-24)- 
The  results  suggest  that  for  the  data  analyzed  here,  acceptable  reliabil¬ 
ities  require  about  24  raters. 

Stability 

Another  view  of  the  reliability  of  the  data  can  be  gained  by  exam¬ 
ining  the  agreement  between  the  mean  data  obtained  in  the  pretest  with 
that  obtained  in  the  major  data  collection  effort  for  the  two  specialties. 
Munitions  Maintenance  and  Fire  Protection,  which  were  common  to  both 
study  aspects.  The  correlation  was  obtained  between  the  categorical 
scale  judgments  of  the  two  specialties  pretested  and  those  of  the  equiv¬ 
alent  judgments  from  the  final  data  collection.  We  note  that  changes  in 
methods  and  scaling  procedures  will  serve  to  reduce  the  level  of  such 
coefficients.  The  following  results  provide  considerable  support  for  the 
employed  technique's  reliability. 


Fire  Protection  (571)  r 

Amount  .  7  8 

Performance  Quality  Variability  .53 

Munitions  Maintenance  (461) 

Amount  .  8 1 

Performance  Quality  Variability  .  72 


Hater  Error 

The  use  of  human  judgment  (rating  scale  procedures)  in  the  pre¬ 
sent  case  rests  on  the  assumption  that  the  human  observer  represents 
a  suitable  observational  instrument  and  is  capable  of  achieving  precision 
and  objectivity.  While  we  have  confidence  in  quantitative  human  .judg¬ 
ments,  we  are  also  aware  of  sources  of  bias  in  such  judgments.  Accord¬ 
ingly,  the  effects  of  three  types  of  rating  error  on  the  data  were  inves¬ 
tigated.  They  include  rating  errors  termed  b>  Cuilford  (1954)  as  con¬ 
trast,  leniency ,  and  halo. 

The  tendency  for  some  raters  to  rate  the  ability  required  b\  a 
task  against  the  rater's  own  level  on  the  skill  is  called  contrast  error. 

For  example,  some  raters  who  are  high  on  manual  dexterity  might 
systematically  tend  to  rate  sin  !i  tasks  as  requiring  a  low  amount  of  this 
ability. 


Table  4-31 


Reliability  of  Subordinate  and  Supervisory  Ratings 
_ for  a  Variety  of  Sample  Sizes  and  AKSCs _ 


Subordinates 

AFSC 

(1) 

No .  of 
(8) 

Judges 

(16) 

(24) 

Inventory  Management,  Materiel  Facilities 
and  Supply  Systems  (645X0) 

.098 

.465 

.635 

.723 

Airman  Administration  (702X0) 

.269 

.746 

.855 

.898 

Weapons  Mechanic  (462X0) 

.  184 

.643 

.783 

.844 

Jet  Engine  Mechanic  (426X2) 

.249 

.726 

.841 

.888 

Supervisors 

AFSC 

(1)-  _ 

No .  of 

.  ill  -  _ 

Judges 

J _ 

(24) 

Inventory  Management,  Materiel  Facilities 
and  Supply  Systems  (645X0) 

.453 

.869 

.930 

.952 

Airman  Administration  (702X0) 

.530 

.900 

.947 

.964 

Weapons  Mechanic  (462X0) 

.152 

.589 

.741 

.811 

Jet  Engine  Mechanic  (426X2) 

.179 

.636 

.777 

.840 

1  (it) 


Leniency  error  occurs  when  raters  systematically  judge  some 
tasks  or  abilities  to  be  high  or  low  because  they  have  some  interest  in 
the  abilities  or  tasks.  For  example,  there  are  "hard"  raters  and  "easy" 
raters.  Some  raters  may  "lean  over  backwards"  to  avoid  rating  an 
ability  as  more  important  than  it  really  is. 

Halo  error  would  occur  in  the  present  context  when  a  judge,  who 
rates  a  given  task  as  high  or  low  on  a  given  ability  tends  to  carry  this 
judgment  over  to  other  abilities.  One  result  of  the  halo  effect  is  to 
force  the  ratings  in  the  direction  of  a  general  impression. 

The  same  data  set  as  employed  (AFSCs  and  raters)  for  the  prior 
reliability  analysis  was  employed  in  the  analysis  of  rater  error. 

Eight  separate  variance  analyses  were  completed,  four  for  sub¬ 
ordinates  and  four  for  supervisory  raters,  to  define  error  sources. 
From  a  variance  summary,  it  is  possible  to  estimate  the  strength  of  as¬ 
sociation  between  the  independent  and  dependent  variables.  This  strength 
of  association  statistic  was  employed  in  the  present  case  as  a  method  for 
interpreting  sources  of  variance  in  terms  of  the  proportionate  contribution 
of  each  source  or  order  of  importance  (Kirk,  1968,  pp.  126,  134,  198). 
Table  4-32  presents  the  formulas  employed  for  estimating  the  strength 
of  association  (Kirk,  1968).  Using  the  triple  interaction  variance  as  an 
estimate  of  residual  variance,  conclusions  may  be  obtained  with  respect 
to  main  effects  and  first  order  interactions.  Variance  components  are 
important  in  the  interpretation  of  results  since  even  trivial  association 
among  means  may  achieve  statistical  significance  if  the  sample  is  suf¬ 
ficiently  large.  An  association  measure  states  whether  or  not  effects 
are  large  or  small  independently  of  the  statistical  significance  of  F 
ratios. 


Tables  4-33  and  4-34  present  association  values  (w^)  indicating 
the  proportion  of  variance  in  the  dependent  variable  accounted  for  by 
each  of  the  independent  valuables.  Each  dependent  variable  is  a  differ¬ 
ent  specialty.  Mean  association  values  across  four  AFSCs  appear  in 
the  last  column  of  each  of  the  tables.  The  last  row  of  each  of  the  tables 
indicates  the  total  proportion  of  variance  accounted  for  in  each  dependent 
variable.  Table  4-33  includes  the  summary  of  the  analysis  of  subordi¬ 
nate's  data.  Table  4-34  displays  the  results  from  the  supervisor  anal¬ 
ysis. 


Association  values  due  to  raters  indicating  leniency  error  was 
low  to  moderate  across  all  analyses  performed.  Contrast  bias  evidenced 
in  the  rater-by-ability  interactions  was  also  low  to  moderate  in  seven 
of  the  eight  analyses  performed.  Halo  bias,  evidenced  by  variance  in 
the  rater-by-task  interaction,  proved  quite  low  for  seven  of  the  eight  anal¬ 
yses. 
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Table  4-32 


Formulas  Employed  for  Estimating  Strength  of  Association  (w2) 
Between  Independent  and  Dependent  Variables _ 


(S)  Rater:  „2  |  = 

‘  SS  i  \r n _ 


total  +  MSsab 


(A)  Task:  w2X  [A  ~ 


ssA  -  (p-1)  mssab 

SStotal  +  MSgAB 


(B)  Ability:  W“X|B  -  SStotal  +  MS 


ssB  -  (q-D  hssab 


SAB 


S  x  A: 


w2x|sa 


SSSA  ~  (n-l)(p-l)  MSsab 
SStotal  +  MSSAB 


S  x  B: 


w2x|sb 


SSSB  -  (n-1) (q-1)  MSsab 
SStotal  +  MSgAB 


A  x  B: 


w2xlAB 


ssAB  (p-D(q-i)  mssab 

sstotal  +  MSsaB 


Note:  —  S  =  Raters 
A  *  Tasks 
B  ■  Abilities 
n  =  8  Raters 

p  •  15  Tasks 
q  =  4  Abilities 


Table  4-33 


Strength  of  Association  (w^)  Between 
Independent  and  Dependent  Variables  for  Subordinate  Haler:: 


Independent  Variable 

4262 

AFSC 

4620 

Dependent 

6450 

Variable 

7020 

Mean 

Rater  (S) 

.214 

.186 

.262 

.320 

.2455 

Tasks  (A) 

.034 

.001 

.018 

.010 

.0157 

Abilities  (B) 

.093 

.071 

.010 

.059 

.0583 

S  x  A 

.000 

.077 

.079 

.011 

.0417 

S  x  B 

.  172 

.297 

.383 

.305 

.2892 

A  x  B 

.029 

.008 

.000 

.028 

.0162 

SUM  (wp 

.542 

.640 

.752 

.733 

.  6666 

*Negative  entries  were  assigned  a  zero  value 
(Kirk,  1968,  P.  198) 


Table  4-34 


Strength  of  Association  ( \v ^ )  Between 
Independent  and  Dependent  Variables  for  Supervisory  Raters* 


AFSC  Dependent  Variable 


Independent  Variable 

4262 

4620 

6430 

7020 

Mean 

Rater  (S) 

.320 

.180 

.085 

.437 

.2555 

Task  (A) 

.035 

.009 

.008 

.013 

.0163 

Abilities  (B) 

.005 

.042 

.341 

.071 

.1147 

S  x  A 

.116 

.002 

.005 

.0307 

S  x  B 

.174 

.211 

.092 

.273 

.1875 

A  x  B 

.055 

.023 

.019 

.067 

.0410 

SUM  (W2) 

.589 

.581 

.547 

.866 

.6457 

*Negative  entries  were  assigned  a  zero  value  (Kirk,  1968,  P.  198) 


For  the  subordinates,  contrast  bias  (which  is  percentage  of  var¬ 
iance  in  the  rater-by-ability  interaction)  amounted  to  28.  9%;  leniency 
error  (which  is  variance  in  the  rater  main  effect)  amounted  to  24.  6%. 
Halo  bias  (which  is  variance  in  the  rater-by-task  interaction)  amounted 
to  only  4.2%. 

When  the  supervisory  ratings  are  considered  (Table  4-34),  con¬ 
trast  bias,  measured  by  the  rater-by-ability  interaction,  amounted  to 
18.7%.;  leniency  error,  measured  by  the  rater  main  effect,  amounted  to 
25.6%.  Halo  bias,  measured  by  the  rater-by-task  interaction,  amount¬ 
ed  to  only  3.  1%. 


♦ 
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V.  SUMMARY  AND  CONCLUSIONS 


Summary 

In  order  to  derive  a  perceptual/psychomotor  skill  taxonomy  which 
could  provide  the  basis  for  analyzing  the  perceptual/psychomotor  require  - 
ments  of  various  AFSCs,  an  extensive  literature  analysis  was  conducted. 
The  analysis  served  to  isolate  perceptual/psychomotor  descriptors  which 
have  been  employed  previously  by  others.  These  descriptors  were  re¬ 
duced  through  an  empirical  analysis  which  compared  each  descriptor 
with  a  variety  of  screening  criteria.  The  end  result  was  a  perceptual/ 
psychomotor  taxonomy  which  contained  13  classes:  finger  dexterity, 
manual  dexterity,  control  precision,  rate  control  (tracking),  visual  mem¬ 
ory,  visual  speed  and  accuracy,  position  memory,  auditory  discrimina¬ 
tion,  auditory  memory,  clerical  perception,  depth  perception,  divided 
attention,  and  kinesthetic  memory. 

A  method  was  devised  which  would  allow  development  of  data 
about  the  amount  of  each  of  the  perceptual/psychomotor  classes  involved 
in  the  performance  of  the  tasks  of  an  AFSC,  and  the  performance  qual¬ 
ity  variability  produced  of  each  of  the  classes  when  the  tasks  of  an  AFSC 
are  performed.  The  data  collection  method  was  modeled  after  the  job 
inventory  procedures  developed  and  currently  used  by  the  Air  Force. 
This  procedure  essentially  involves  a  checklist  of  tasks  which  is  com¬ 
pleted  by  a  job  incumbent  relative  to  a  set  of  attributes.  In  the  present 
case,  the  attributes  were  the  taxonomic  classes  and  each  list  contained 
a  sample  of  the  tasks  performed  in  each  AFSC  investigated. 

A  pretest  of  the  procedure  indicated  that  the  method  yielded  data 
possessing  sufficient  quality  to  meet  the  goal  of  the  present  work- -to 
provide  a  description  of  the  perceptual/ psychomotor  requirements  of 
various  AFSCs.  The  job  incumbent  raters  (supervisors  and  subordi¬ 
nates)  were  able  to  understand  the  taxonomy,  the  scaling  procedures, 
and  the  methods  for  responding.  The  results,  based  on  data  collected 
during  the  pretest  phase,  also  suggested  adequate  test-retest  reliability. 
Scaling  procedure  or  rater  variables  (supervisor  or  subordinate)  did  not 
seem  to  affect  the  results.  However,  the  pretest  also  indicated  a  num¬ 
ber  of  areas  of  potential  problems.  These  largely  concerned  range  re¬ 
striction  and  discriminating  power.  To  cope  with  these  problems  during 
the  major  data  collection  effort,  modifications  were  incorporated  into 
the  methods. 

The  revised  methods  were  applied  to  collect  perceptual/ psycho¬ 
motor  requirements  information  about  35  AFSCs  at  10  Air  Force  bases 
within  the  SAC,  TAC,  and  MAC  major  commands.  The  task  list  for 
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each  specialty  contained  a  sample  of  60  tasks  performed  by  incumbents 
in  that  specialty.  The  resultant  data  were  analyzed  to  yield  the  "high" 
and  the  "low"  perceptual/ psychomotor  ability  requirements  for  each  of 
the  AFSCs  involved.  Across  all  35  AFSCs  considered,  the  four  most 
highly  rated  perceptual/ psychomotor  abilities  for  both  amount  and  per¬ 
formance  quality  variability  were:  visual  memory,  visual  speed  and  ac¬ 
curacy,  finger  dexterity,  and  manual  dexterity.  The  four  lowest  rated 
abilities  for  both  rated  aspects  were:  auditory  memory,  auditory  dis¬ 
crimination,  kinesthetic  memory,  and  depth  perception. 

A  high  correlation  (r  =  .97)  was  found  between  the  ratings  of 
"amount"  and  of  "performance  quality  variability.  "  This  suggests  that 
only  one  or  the  other  of  these  factors  need  be  included  in  future  sur¬ 
veys  of  this  type.  As  in  the  pretest,  the  correlation  between  the  data 
yielded  by  supervisors  and  by  subordinates  was  high.  For  the  amount 
factor  the  correlation  between  the  ratings  made  by  the  two  sets  of  judges 
was  .94;  for  the  performance  quality  variability  factor,  the  correlation 
was  .  90. 

Indices  of  profile  similarity  indicated  support  for  a  contention 
that  the  perceptual/ psychomotor  requirements  for  most  AFSCs  are  at 
least  partially  unique. 

A  reliability  analysis  indicated  that  about  24  raters  are  required 
to  produce  adequate  stability  within  the  techniques  employed. 

Sources  of  rater  error- -leniency,  contrast,  and  halo- -were  in¬ 
vestigated  and  found  to  be  present  but  not  to  a  large  extent. 

A  factor  analysis  of  the  data  indicated  that  the  taxonomy  can  be 
described  by  three  factors --a  visual,  an  auditory,  and  a  manual  factor. 


Conclusions 


Within  the  limits  of  the  present  data  set,  the  following  conclu¬ 
sions  seem  warranted: 

1.  The  taxonomy,  here  developed  and  employed, 
can  provide  a  basis  for  describing  the  percep¬ 
tual/psychomotor  requirements  of  various 
AFSCs. 

2.  The  methods  and  procedures,  here  developed 
and  employed,  seem  to  produce  information  of 
adequate  quality  and  can  be  employed  in  future 
investigations  of  the  present  type. 
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3.  The  various  AFSCs  are  somewhat,  but  not  high¬ 
ly,  independent  relative  to  the  perceptual/ psy¬ 
chomotor  abilities  required  for  effective  perform¬ 
ance.  No  AFSC  was  free  from  perceptual/psy¬ 
chomotor  requirements. 

4.  About  24  judges  are  required  to  produce  adequate 
data  stability  within  the  techniques  employed. 

5.  By  extrapolation,  the  results  of  the  present  work 
can  be  employed  as  a  basis  for  career  classifica¬ 
tion  and  perceptual/ psychomotor  test  development. 
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APPENDIX  A 


Pretest  Forms 


♦ 


J 


I 


SECTION  1 


AMOUNT  OF  PERCEPTUAL/ PSYCHOMOTOR  ABILITY 

Part  1 


Your  task  is  to  judge  how  much  of  each  of  a  set  of  perceptual/ 
psychomotor  abilities  is  involved  in  a  number  of  the  duties  in  your  ca¬ 
reer  field.  To  provide  this  information  you  should; 

1.  Make  sure  you  understand  the  definition  of  each  ability 
which  is  defined  in  the  "Perceptual/  Psychomotor  Ability 
Definitions"  list. 

2.  Head  the  first  duty  in  the  duty  list  (last  page  of  this  "Part"). 
Refer  to  the  first  ability  definition,  finger  dexterity  (FD), 
and  decide  how  much  is  involved  in  performing  the  first 
duty.  Enter  your  estimate  in  the  first  column.  Use  the 
amount  scale  below  in  making  your  judgment. 

Amount 

N  =  duty  not  performed  in  your  squadron 
NR  -  performed,  but  ability  is  not  required 
in  duty  performance 

1  =vex-y  little  (0%  -  20%) 

2  =  some  (21%  -  40%) 

3  =  moderate  (41%  -  60%) 

4  =  considerable  (61%  -  80%) 

5  =very  much  (81%  -  100%) 

3.  Repeat  the  same  step  for  the  second  duty,  and  so  on  until 
every  line  in  the  finger  dexterity  column  is  filled  in. 

4.  Evaluate  all  the  duties  for  the  second  ability,  manual  dex¬ 
terity,  in  the  same  manner.  Enter  your  judgment  for  this 
ability  in  the  second  column. 

5.  Continue  in  this  manner  until  every  duty  has  been  evaluated 
for  all  the  abilities. 

6.  Refer  to  the  ability  definitions  as  often  as  necessary  when 
making  your  judgments. 


Instructions  for  Parts  1  and  2  in  Section  1  of  the  pretest 
data  collection  forms. 
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7.  An  example  of  how  to  complete  Part  1  is  presented 
below.  For  the  first  ability,  finger  dexterity,  the 
person  making  the  judgment  thought  that  "conducting 
inventories"  requires  "very  little"  finger  dexterity. 

He  considered  finger  dexterity  to  represent  about 
10%  of  the  duty.  Accordingly,  he  entered  a  "l"  on 
the  first  line  of  the  first  column.  For  the  second 
duty,  "maintaining  files,"  the  rater  thought  that 
finger  dexterity  represents  35%  of  "maintaining  files." 
Therefore,  he  wrote  a  ”2"  alongside  the  second  duty 
in  the  first  column. 


Perceptual/Psychomotor  Ability 
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8.  Raters  sometimes  make  errors  of  judgment  when  using 
forms  such  as  this.  To  avoid  these  errors: 

a.  use  the  high  and  the  low  numbers  (1  and  5)  of 
the  scale  whenever  appropriate 

b.  avoid  excessive  use  of  the  middle  number  (3) 
of  the  scale 

c.  avoid  assignment  of  the  same  value  to  all 
abilities  in  a  duty 

9.  Enter  "N"  alongside  any  duty  that  is  not  performed  in  your 
squadron. 

10.  Enter  "NR"  in  the  box  for  any  ability  that  is  not  required  in 
the  performance  of  the  duty. 


Part  2 


In  Part  2,  your  task  is  to  judge  again  how  much  each  of  the  set  of 
perceptual/ psychomotor  abilities  is  involved  in  a  number  of  the  duties  in 
your  career  field.  To  provide  this  information  you  should: 

1.  Make  sure  you  understand  the  definition  of  each  ability 
which  is  defined  in  the  "Perceptual/  Psychomotor  Ability 
Definitions"  list. 

2.  Read  the  first  duty  in  the  duty  list  (last  page  of  this 
"Part").  Refer  to  the  first  ability  definition,  finger 
dexterity  (FD),  and  decide  how  much  is  involved  in 
performing  the  first  duty.  Enter  your  estimate  in 
the  first  column.  Use  the  amount  scale  below  in 
making  your  judgment.  You  may  use  any  value  from 
zero  to  100. 

Amount 

I _ I _ I _ 1 _ 1 _ I _ I _ 1 _ I _ 1 _ I  . L-  .  I . . I-.  I.  I.  I  I  I  I  I 

0  10  20  30  40  50  60  70  80  90  100 

Very  little  Some  Moderate  Considerable  Very  much 

3.  Repeat  the  same  step  for  the  second  duty,  and  so  on  until 
every  line  in  the  finger  dexterity  column  is  filled  in. 

4.  Evaluate  all  the  duties  for  the  second  ability,  manual 
dexterity,  in  the  same  manner.  Enter  your  judgment 
for  this  ability  in  the  second  column. 

5.  Continue  in  this  manner  until  every  duty  has  been  eval¬ 
uated  for  all  the  abilities. 

6.  Refer  to  the  ability  definitions  as  often  as  necessary 
when  making  your  judgments. 

7.  An  example  of  how  to  complete  Part  2  is  presented  below. 

For  the  first  ability,  finger  dexterity,  the  person  making 
the  judgment  thought  that  "conducting  inventories"  requires 
"very  little"  finger  dexterity.  Accordingly,  he  entered 

a  "10"  on  the  first  line  of  the  first  column.  For  the  second 
duty,  "maintaining  files,"  the  rater  thought  that  "some" 
amount  of  finger  dexterity  is  involved.  Therefore,  he  en¬ 
tered  a  "25"  alongside  the  second  duty  in  the  first  column. 
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Perceptual/Psychomotor  Ability 
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8.  Raters  sometimes  make  errors  of  judgment  when  using 
forms  such  as  these.  To  avoid  these  errors; 

a.  use  the  high  (80  to  100)  and  the  low  numbers  (0  to 
20)  of  the  scale  whenever  appropriate 

b.  avoid  excessive  use  of  the  middle  number's  (45  to  55) 
of  the  scale 

c.  avoid  assignment  of  the  same  value  to  all  abilities 
in  a  duty 

9.  Enter  "N"  alongside  any  duty  that  is  not  performed  in  your 
squadron. 

10.  Enter  "NR"  in  the  box  for  any  ability  that  is  _not ^required 
in  the  performance  of  the  duty. 
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SECTION  II 

PERFORMANCE  QUALITY  VARIABILITY  AS  A  FUNCTION  OF 
PERCEPTUAL/ PSYCHOMOTOR  ABILITY 

Part  1 


Your  task  in  Section  II  is  to  judge  how  performance  differences 
on  a  particular  duty  vary  as  a  function  of  a  specific  perceptual/ psycho¬ 
motor  ability.  In  completing  the  form,  you  should  ask  yourself  the  ques 
tion;  For  a  great  number  of  people,  how  large  are  the  differences  in 
the  performance  of  the  duty,  as  a  function  of  this  specific  ability?  Your 
responses  will  provide  information  about  the  quality  of  performance, 
over  large  numbers  of  people.  To  provide  this  information  you  should: 

1.  Make  sure  you  understand  the  definition  of  each  ability 
which  is  defined  in  the  "Perceptual/ Psychomotor  Ability 
Definitions"  list. 

2.  Read  the  first  duty  in  the  duty  list.  Refer  to  the  first 
ability  definition,  finger  dexterity  (FD),  and  decide  on 
the  extent  of  the  performance  difference  which  exists 
between  people  who  perform  the  duty  as  a  function  of 
finger  dexterity.  Enter  your  estimate  in  the  first  col¬ 
umn.  Use  the  performance  quality  variability  scale  be¬ 
low  in  making  your  judgment. 

Performance  Quality  Variability 

N  =  duty  not  performed  in  your  squadron 
NR  *  performed,  but  ability  is  not  required  in  duty  performance 

1  »  quality  of  performance  of  this  duty  varies  little,  because  of 

differences  among  current  personnel  in  this  ability 

2  *  quality  of  performance  of  this  duty  varies  some  because  of 

differences  among  current  personnel  in  this  ability 

3  **  quality  of  performance  of  this  duty  varies  moderately  because 

of  differences  among  current  personnel  in  this  ability 

4  =  quality  of  performance  of  this  duty  varies  considerably  because 

of  differences  among  current  personnel  in  this  ability 

5  =  quality  of  performance  of  this  duty  varies  to  a  very  great  extent 

because  of  differences  among  current  personnel  in  this  ability 


Inatruitions  for  Parts  1  and  2  in  Section  11  of  the  pretest 
data  collection  forms. 
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3.  Repeat  the  same  step  for  the  second  duty,  and  so  on  until 
every  line  in  the  finger  dexterity  column  is  filled  in. 


4.  Evaluate  all  the  duties  for  the  second  ability,  manual  dex¬ 
terity  in  the  same  manner.  Enter  your  judgment  for  this 
ability  in  the  second  column. 

5.  Continue  in  this  manner  until  every  duty  has  been  eval¬ 
uated  for  all  the  abilities. 

6.  Refer  to  the  ability  definitions  as  often  as  necessary  when 
making  your  judgments. 

7.  An  example  of  how  to  complete  Part  1  is  presented  below. 
For  the  first  ability,  finger  dexterity,  the  person  making 
the  judgment  thought  that  quality  of  performance  of  the 
duty,  "conducting  inventories,  "  varies  "little"  among  cur¬ 
rent  personnel  because  of  differences  in  finger  dexterity. 
Accordingly,  he  entered  a  "l"  on  the  first  line  of  the  first 
column.  For  the  second  duty,  "maintaining  files,"  the  rater 
thought  that  finger  dexterity  differences  among  current 
personnel  have  "some"  effect  on  the  quality  of  performance. 
Therefore,  he  wrote  a  "2"  alongside  the  second  duty  in  the 
first  column. 
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8.  Raters  sometimes  make  errors  of  judgment  when  using  forms 

such  as  these.  To  avoid  making  these  errors; 

a.  use  the  high  and  the  low  numbers  (1  and  5)  of  the 
scale  whenever  appropriate 

b.  avoid  excessive  use  of  the  middle  number  (3)  of 
the  scale 

c.  avoid  assignment  of  the  same  value  to  all  abilities 
in  a  duty 


9.  Enter  "N"  alongside  any  duty  that  is  not  performed  in 
your  squadron. 

10.  Enter  "NH"  in  the  box  for  any  ability  that  is  not  required 
in  the  performance  of  the  duty. 


Part  2 

In  Part  2,  your  task  is  to  judge  again  how  performance  differences 
on  a  particular  duty  vary  as  a  function  of  a  specific  perceptual/  psycho¬ 
motor  ability.  In  completing  the  form,  you  should  ask  yourself  the  ques¬ 
tion;  Por  a  great  number  of  people,  how  large  are  the  differences  in  the 
performance  of  the  duty,  as  a  function  of  this  specific  ability?  Your  re¬ 
sponses  will  provide  information  about  the  quality  of  performance,  over 
large  numbers  of  people.  To  provide  this  information  you  should; 

1.  Make  sure  you  understand  the  definition  of  each  ability 
which  is  defined  in  the  "Perceptual/  Psychomotor  Abil¬ 
ity  Definitions"  list. 

2.  Head  the  first  duty  in  the  duty  list.  Hefei-  to  the  first 
ability  definition,  finger  dexterity  (KD),  and  decide  on 
the  extent  of  the  performance  difference  which  exists 
between  people  who  perform  the  duty  as  a  function  of 
finger  dexterity.  Enter  your  estimate  in  the  first  col¬ 
umn.  Use  the  performance  quality  variability  scale 
below  in  making  your  judgment.  You  may  use  any 
value  from  /.or o  to  100. 


Little  Some  Moderate  Considerable  Great  extent 


3.  Hepeat  the  same  step  for  the  second  duty,  and  so  on  until 
every  line  in  the  finger  dexterity  column  is  filled  in. 

4.  Evaluate  all  the  duties  for  the  second  ability,  manual  dex¬ 
terity,  in  the*  same  manner.  Killer  your  judgment  for  this 
ability  in  the  second  column. 
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5.  Continue  in  this  manner  until  every  duty  has  been  evaluated 
for  all  the  abilities. 

6.  Refer  to  the  ability  definitions  as  often  as  necessary  when 
making  your  judgments. 


7.  An  example  of  how  to  complete  Part  2  is  presented  below. 
For  the  first  ability,  finger  dexterity,  the  person  thought 
that  quality  of  performance  of  the  duty,  "conducting  inven¬ 
tories,"  varies  a  "little"  amount  among  current  personnel 
because  of  differences  in  finger  dexterity.  Accordingly, 
he  entered  a  "10"  on  the  first  line  of  the  first  column.  For 
the  second  duty,  "maintaining  files,"  the  rater  thought 
that  finger  dexterity  differences  among  current  personnel 
have  "some"  effect  on  the  quality  of  performance.  There¬ 
fore,  he  wrote  "25"  alongside  the  second  duty  in  the  first 
colu  mn. 


Perceptual/Psychomotor  Ability 


Dut£ 

1.  Conducting 


2.  Maintaining 
files 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

FD 

MD 

CP 

RC 

VM 

VSA 

PM 

AD 

AM 

CP 

DP 

DA 

KM 

35 

Ho 

NR 

<r& 

62 

HR 

HR 

23 

NR 

NR 

\5 

lo 

NR 

5 

50 

50 

NR 

Nft 

SO 

2. 

75 

NR 

Nft 

8.  Raters  sometimes  make  errors  of  judgment  when  using  forms 

such  as  these.  To  avoid  making  these  errors: 

a.  use  the  high  (80  to  100)  and  the  low  (0  to  20)  ends 
of  the  scale  whenever  appropriate 

b.  avoid  excessive  use  of  the  central  area  of  the 
st  ale  (45  to  55) 

c.  avoid  assignment  of  the  same  value  to  all  abil¬ 
ities  in  a  duty 


9.  Enter  "N"  alongside  those  duties  that  are  not  performed  in 
your  squadron. 

10.  Enter  "NR"  in  the  box  for  any  ability  that  is  ^ot  required 
in  the  performance  of  the  duty. 


The  response  sheets  were  arranged  with  the  13  perceptual/ 
psychomotor  abilities  in  vertical  columns,  with  legends  across  the 
top  of  the  page.  The  tasks  were  identified  along  the  left  side  of 
the  page.  A  sample  response  sheet  is  shown  in  Exhibit  A-l.  In  order 
to  balance  the  effects  of  fatigue  and  practice,  the  sequence  of  tasks 
in  each  of  the  two  parts  in  each  survey  form  section,  were  reversed. 
Accordingly,  tasks  ordered  from  1  to  20  in  Part  1  of  the  two  sections 
were  ordered  from  the  twentieth  task  first  to  the  first  task  list  in 
the  second  part  of  the  survey  form. 


511  AirKxml  I>rr Vuycbomoior  Ability 


APPENDIX  B 


Interview  Form  Used  In  Pretest 
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PERCEPTUAL/ PSYCHOMOTOR 
REQUIREMENTS  INTERVIEW 


Name _  Date 

Rank _  Squadron _  Location 

Career  Field 


I  HAVE  A  SHORT  INTERVIEW  WHICH  WILL,  IN  PART,  BE  BASED 
ON  THE  FORM  YOU  COMPLETED.  YOUR  ANSWERS  WILL  BE  HELD 
CONFIDENTIAL.  THE  DATA  WILL  BE  TREATED  STATISTICALLY  AND 
YOUR  NAME  WILL  NOT  BE  ASSOCIATED  WITH  IT  IN  ANY  WAY.  THANK 
YOU  FOR  YOUR  COOPERATION. 


I 


1.  (show  card)  How  long  have  you  been  in  (career  field) _ 

(1)  Less  than  6  months 

(2)  Between  6  months  and  1  year 

(3)  1  to  3  years 

(4)  3  to  5  years 

(5)  More  than  5  years 

2.  (show  card)  How  long  have  you  been  stationed  at _ ' 

(1)  Less  than  6  months 

(2)  Between  6  months  and  1  year 

(3)  1  to  3  years 

_ (4)  3  to  5  years 

(5)  More  than  5  years 

3.  (show  card)  How  long  have  you  been  in  the  Air  Force? 

_ (1)  Less  than  (i  months 

(2)  Between  6  months  and  1  year 
_ (3)  1  to  3  years 

(4)  4  to  5  years 

_ (5)  More  than  5  years 

4.  (show  card)  What  other  perceptual/psychomotor  abilities  that  were 

not  included  in  the  list,  are  required  in  performing  the 
the  duties  listed  in  the  questionnaire ? 


5,  (show  card) 


5.  (show  card)  Are  there  any  perceptual/ psychomotor  abilities  that  may 
be  required  at  some  locations  or  duty  stations  that  would 
not  be  required  at  others?  Which  and  how  so? 
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6.  (show  card)  Which  perceptual/ psychomotor  abilities  were  not 
meaningful  to  you?  How  so? 


7.  (show  card)  Which  two  statements  best  describes  your  opinion  of 
the  categorical  questionnaire  (identify)?  The  magni¬ 
tude  questionnaire  (identify)? 

Categorical  Magnitude 

A  good  approach  _  _ 

Unclear  _  _ 

Difficult  to  see  _  _ 

Provides  inadequate 

information  _  _ 

Easy  to  use  _  _ 

Poor  approach  _  _ 

Hard  to  understand  _ 

Provides  a  lot  of  in¬ 
formation 
Easy  to  interpret 
Clear 


8.  (show  card)  In  general,  iiow  difficult  was  it  for  you  to  complete 
the  categorical  questionnaire?  The  magnitude 
questionnaire  ? 


Categorical  Magnitude 

Very  difficult  _ 

Moderately  difficult  _  _ 

Neither  difficult  or 

oasy  _  _ 

Moderately  easy  _  _ 

Very  easy  _  _ 
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9.  Do  you  have  any  suggestions  that  would  be  helpful  to  us  for  im¬ 
proving  the  form  that  you  completed  so  that  it  will  be  more  use¬ 
able? 


10.  Please  provide  a  judgment  indicating  the  amount  that  each  perceptual/ 
psychomotor  ability  is  involved  in  each  of  the  following  duties.  (Pro¬ 
vide  definitions.  Enter  responses  on  the  answer  sheets  for  the  inter¬ 
viewee.  Within  each  career  field  half  the  interviewees  use  the  cate¬ 
gorical  scale  and  half  use  the  magnitude  estimation  scale). 


11.  Please  provide  a  judgment  indicating  how  large  the  differences  in 
performance  varies  as  a  function  of  the  specific  ability.  (Provide 
definitions.  Enter  responses  on  the  answer  sheets  for  the  inter¬ 
viewee.  Within  each  career  field,  those  interviewees  who  received 
the  categorical  scale  in  item  10  should  receive  the  same  scale  for 
this  exercise.  Similarly,  those  who  used  the  magnitude  estimation 
scale  in  item  10  should  use  it  again  for  this  item). 
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APPENDIX  F 


Letter  introdueiii"  Survey 


I 


REPI.V  TO 
ATTN  O?' 


suajicr. 


TO: 


DEPARTMENT  OF  THE  AIR  FORCE 
AIR  FORCE  KOMAR  RESOURCES  LABORATORf  (AFSCI 
BROOKS  AIR  FORCE  BASE.  TEXAS  78235 


AFHRl/OR 

Administrative  Support  for  Job  Requirements  Study 


Occupational  Survey  Control  Officer 

1.  As  a  Headquarters  USAF-approyed  project,  this  Laboratory  conducts 
research  on  establishing  job  requirements  in  the  err  listed,  special  ties...  fin. 
important  part  of  this  effort  Is  the  development  of  job  survey  Instruments 
for  use  in  determining  minimum  entry  requirements  into  various  AFSs.  In 
connection  with  this  research  effort,  the  firm  of  Applied  Psychological 
Services  Inc.,  working  under  AF  Contract  F33S15-78-C-0032 ,  is  required  to 
gather  job  requirements  data  at  a  representative  sample  of  Air  Force 
installations. 

2.  We  request  permission  for  two  (2)  contractor  personnel  to  visit  your 
CBRO  far  purposes  of  administering  a  job  requirements  survey  to  selected 
samples  of  enlisted  personnel .  The  contractor  personnel  will  bring  all 
necessary  survey  materials  for  group  administration  and  will  conduct  the 
sessions  under  your  supervision.  Since  the  number  of  respondents  is  large 
and  varies  by  installation,  we  would  also  request  administrative  support 
in  bringing  groups  of  personnel  within  your  jurisdiction  to  a  central 
testing  location  on  a  schedule  that  is  compatible  with  your  office.  Rosters 
will  be  provided  or,  if  preferred,  we  will  supply  individual  address  labels 
for  use  in  contacting  respondents  through  base  distribution. 

3.  It  is  anticipated  that  most  of  the  survey  administration  activity  can 
be  conducted  within  a  week’s  time.  (See  survey  schedule  at  Atch  I). 

Further  instructions  and  administrative  material  for  the  project  will  be 
forwarded  within  the  next  two  weeks.  We  appreciate  your  assistance  in 
this  effort. 


1  Atch 

Survey  Schedule 


Introductory  letter  forwarded  to  all  Air  Bases  included  in  the  sampLe, 
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